BenchLeader

Gemini 3.7 Flash vs Qwen3 8

Verdict
  • Gemini 3.7 Flash (medium) and Qwen3 8 (max) are level on quality (64.4 vs 63.9).
  • Gemini 3.7 Flash (medium) is stronger in composite, knowledge, long context, multimodal.
  • Qwen3 8 (max) is stronger in coding, reasoning, agents & tools, human preference.
  • Gemini 3.7 Flash (medium) is 1.8× cheaper ($1.50 vs $2.67 per 1M blended).
  • Gemini 3.7 Flash (medium) streams 7.2× faster (282 vs 39 tokens per second).
MetricGemini 3.7 Flash (medium)Qwen3 8 (max)
BenchLeader Index64.463.9
Coding score68.371.7
Composite score78.970.8
Knowledge score75.262.3
Long context score68.165.7
Multimodal score69.467.2
Reasoning score63.567.7
Agents & tools score56.1
Human preference score67.9
Blended price $/M$1.50$2.67
Output speed282 tok/s39 tok/s
Time to first answer5.3 s53.2 s
Context window1M1M
SciCode57.9%
Epoch Capabilities Index156.6
LMArena Text1480
LMArena Hard Prompts1502
LMArena Coding1520
LMArena WebDev1685
LMArena Vision1313
LMArena Agent3.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index39.640.3
AA-LCR83.0%78.3%
MMMU-Pro84.7%82.3%
AA-Omniscience23.73.4
GPQA Diamond (AA)92.1%92.7%
Humanity's Last Exam (AA)39.0%43.0%
SciCode (AA)59.8%53.2%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8
ARC-AGI-191.2%
ARC-AGI-263.8%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.