BenchLeader

Claude Opus 4.8 vs Gemini 3.7 Flash

Verdict
  • Claude Opus 4.8 and Gemini 3.7 Flash (medium) are level on quality (64.7 vs 64.4).
  • Claude Opus 4.8 is stronger in agents & tools, composite, human preference, instruction following, reasoning.
  • Gemini 3.7 Flash (medium) is stronger in coding, knowledge, long context, multimodal.
  • Gemini 3.7 Flash (medium) is 6.7× cheaper ($1.50 vs $10.00 per 1M blended).
  • Gemini 3.7 Flash (medium) streams 4.9× faster (282 vs 58 tokens per second).
MetricClaude Opus 4.8Gemini 3.7 Flash (medium)
BenchLeader Index64.764.4
Agents & tools score65.0
Coding score65.768.3
Composite score81.978.9
Human preference score65.6
Instruction following score61.6
Knowledge score66.375.2
Long context score65.368.1
Multimodal score64.469.4
Reasoning score64.263.5
Blended price $/M$10.00$1.50
Output speed58 tok/s282 tok/s
Time to first answer29.5 s5.3 s
Context window1M1M
SimpleBench64.8%
SciCode57.9%
Remote Labor Index8.3%
FrontierCode46.5%
GSO-Bench47.1%
Epoch Capabilities Index158.3
LMArena Text1473
LMArena Hard Prompts1503
LMArena Coding1527
LMArena WebDev1540
LMArena Vision1289
AA Intelligence Index42.039.6
IFBench62.2%
AA-LCR77.7%83.0%
MMMU-Pro84.7%
AA-Omniscience28.823.7
Terminal-Bench Hard58.3%
GPQA Diamond (AA)92.0%92.1%
Humanity's Last Exam (AA)48.7%39.0%
SciCode (AA)54.4%59.8%
τ²-Bench Telecom (AA)94.4%
LiveCodeBench87.8%
MMLU-Pro89.6%
LegalBench83.6%
CorpFin66.7%
TaxEval75.6%
Terminal-Bench 2.1 (Vals)71.9%
SWE-bench (Vals)88.6%
GPQA Diamond (Vals)92.4%
Vals Index60.9
HiL-Bench35.3%
EQ-Bench 41281
ARC-AGI-191.2%
ARC-AGI-263.8%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.