Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the...
| Benchmark | Score | Source |
|---|---|---|
| Chatbot Arena Elo | 1207 | |
| IFEval | 83.6 | |
| MMLU-Pro | 66.4 |
| Benchmark | Score | Source |
|---|---|---|
| HumanEval |
80.5 |
| Benchmark | Score | Source |
|---|---|---|
| ARC-Challenge | 94.8 | |
| BigBench-Hard | 81.2 | |
| GPQA Diamond | 46.7 |
| Benchmark | Score | Source |
|---|---|---|
| HellaSwag | 94.4 | |
| WinoGrande | 85.3 |
| Benchmark | Score | Source |
|---|---|---|
| TruthfulQA | 60.1 |