Neura Intelligence Index
| Benchmark | DeepSeek-V4-Flash-Max | Llama 3.3 70B |
|---|---|---|
| GPQA Diamond | 88.1 | 49.5 |
| Humanity's Last Exam | 45.1 | — |
| ARC-Challenge | — | 95.2 |
| BigBench-Hard | — | 82.9 |
| Benchmark | DeepSeek-V4-Flash-Max | Llama 3.3 70B |
|---|---|---|
| SWE-bench Verified | 79 | — |
| SWE-Bench Pro | 52.6 | — |
| HumanEval | — | 88.4 |
| Benchmark | DeepSeek-V4-Flash-Max | Llama 3.3 70B |
|---|---|---|
| SimpleQA | 34.1 | — |
| MMLU-Pro | — | 68.9 |
| Chatbot Arena Elo | — | 1247 |
| IFEval | — | 85.3 |
| Benchmark | DeepSeek-V4-Flash-Max | Llama 3.3 70B |
|---|---|---|
| BrowseComp | 73.2 | — |
| Toolathlon | 47.8 | — |
| MCP Atlas | 69 | — |
| Benchmark | DeepSeek-V4-Flash-Max | Llama 3.3 70B |
|---|---|---|
| HellaSwag | — | 94.8 |
| WinoGrande | — | 86.1 |
| Benchmark | DeepSeek-V4-Flash-Max | Llama 3.3 70B |
|---|---|---|
| TruthfulQA | — | 62.8 |