The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more here. GPT-4o ("o" for "omni") is...
| Benchmark | Score | Source |
|---|---|---|
| GPQA Diamond | 70.1 | verified |
| Humanity's Last Exam | 5.3 | verified |
| Benchmark | Score | Source |
|---|---|---|
| MMMU | 72.2 | verified |
| MMMU-Pro | 59.9 | verified |
| CharXiv Reasoning | 58.8 | verified |
| Benchmark | Score | Source |
|---|---|---|
| TAU-Bench Retail | 60.3 | verified |
OpenAI