BenchLeader

Claude Opus 4.8 vs Gemini 3.5 Flash

Verdict
  • Claude Opus 4.8 and Gemini 3.5 Flash (medium) are level on quality (64.7 vs 63.9).
  • Claude Opus 4.8 is stronger in coding, composite, long context.
  • Gemini 3.5 Flash (medium) is stronger in agents & tools, human preference, instruction following, knowledge, multimodal, reasoning.
  • Gemini 3.5 Flash (medium) is 3.0× cheaper ($3.38 vs $10.00 per 1M blended).
  • Gemini 3.5 Flash (medium) streams 3.6× faster (209 vs 58 tokens per second).
MetricClaude Opus 4.8Gemini 3.5 Flash (medium)
BenchLeader Index64.763.9
Agents & tools score65.067.8
Coding score65.758.9
Composite score81.971.4
Human preference score65.667.4
Instruction following score61.672.2
Knowledge score66.373.9
Long context score65.363.6
Multimodal score64.467.6
Reasoning score64.266.8
Blended price $/M$10.00$3.38
Output speed58 tok/s209 tok/s
Time to first answer29.5 s17.0 s
Context window1M1M
SimpleBench64.8%
Remote Labor Index8.3%
FrontierCode46.5%
GSO-Bench47.1%
Epoch Capabilities Index158.3
LMArena Text14731476
LMArena Hard Prompts15031493
LMArena Coding15271503
LMArena WebDev15401491
LMArena Vision12891306
AA Intelligence Index42.033.6
IFBench62.2%74.6%
AA-LCR77.7%74.3%
MMMU-Pro83.9%
AA-Omniscience28.820.8
Terminal-Bench Hard58.3%39.4%
GPQA Diamond (AA)92.0%92.1%
Humanity's Last Exam (AA)48.7%41.3%
SciCode (AA)54.4%
τ²-Bench Telecom (AA)94.4%95.6%
LiveCodeBench87.8%
MMLU-Pro89.6%
LegalBench83.6%
CorpFin66.7%
TaxEval75.6%
Terminal-Bench 2.1 (Vals)71.9%
SWE-bench (Vals)88.6%
GPQA Diamond (Vals)92.4%
Vals Index60.9
HiL-Bench35.3%
EQ-Bench 41281

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.