Mistral's official instruct fine-tuned version of Mixtral 8x22B. It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include: - strong math, coding,...
| Benchmark | Score | Source |
|---|---|---|
| Chatbot Arena Elo | 1146 | |
| IFEval | 72.4 | |
| MMLU-Pro | 56.8 |
| Benchmark | Score | Source |
|---|---|---|
| HumanEval |
79.3 |
| Benchmark | Score | Source |
|---|---|---|
| ARC-Challenge | 91.3 |
| Benchmark | Score | Source |
|---|---|---|
| HellaSwag | 88.5 | |
| WinoGrande | 82.1 |
| Benchmark | Score | Source |
|---|---|---|
| TruthfulQA | 55.2 |
Mistral AI