Neura Intelligence Index

AI Model Benchmarks

Devin vs Qwen2.5-Omni-7B — Benchmark Comparison | Neura Market

Back to Leaderboard

Devin vs Qwen2.5-Omni-7B

Cognition 🇺🇸

6.1

#301—

Q

Qwen2.5-Omni-7B

Alibaba Cloud / Qwen Team 🇨🇳

7.2

#298—

Category Comparison

Benchmark-by-Benchmark

agent

Benchmark	Devin	Qwen2.5-Omni-7B
GAIA	45	—
WebArena	18	—

coding

Benchmark	Devin	Qwen2.5-Omni-7B
SWE-bench Verified	26.6	—

reasoning

Benchmark	Devin	Qwen2.5-Omni-7B
GPQA Diamond	—	30.8

multimodal

Benchmark	Devin	Qwen2.5-Omni-7B
MMMU	—	59.2
MMMU-Pro	—	36.6

Category Winners

coding

Devin

1.0

reasoning

Q

Qwen2.5-Omni-7B

3.6

multimodal

Q

Qwen2.5-Omni-7B

14.4

agent

Devin

10.0