BenchLeader

Claude Opus 4.7 vs Gemini 3.5 Flash

Verdict
  • Claude Opus 4.7 leads on quality: 65.5 vs 63.9.
  • Claude Opus 4.7 is stronger in agents & tools, coding, composite, human preference, long context, maths.
  • Gemini 3.5 Flash (medium) is stronger in instruction following, knowledge, multimodal, reasoning.
  • Gemini 3.5 Flash (medium) is 3.0× cheaper ($3.38 vs $10.00 per 1M blended).
  • Gemini 3.5 Flash (medium) streams 4.5× faster (209 vs 46 tokens per second).
MetricClaude Opus 4.7Gemini 3.5 Flash (medium)
BenchLeader Index65.563.9
Agents & tools score69.467.8
Coding score64.858.9
Composite score80.371.4
Human preference score68.867.4
Instruction following score58.572.2
Knowledge score66.473.9
Long context score65.963.6
Maths score65.2
Multimodal score65.767.6
Reasoning score66.366.8
Blended price $/M$10.00$3.38
Output speed46 tok/s209 tok/s
Time to first answer21.2 s17.0 s
Context window1M1M
Humanity's Last Exam36.2%
Terminal-Bench80.2%
SimpleBench61.7%
WeirdML76.4%
FrontierCode38.5%
GSO-Bench44.1%
Epoch Capabilities Index156.3
LMArena Text14951476
LMArena Hard Prompts15191493
LMArena Coding15471503
LMArena WebDev15571491
LMArena Vision13171306
AA Intelligence Index40.733.6
IFBench58.6%74.6%
AA-LCR78.7%74.3%
MMMU-Pro78.8%83.9%
AA-Omniscience27.320.8
Terminal-Bench Hard51.5%39.4%
GPQA Diamond (AA)91.4%92.1%
Humanity's Last Exam (AA)42.3%41.3%
τ²-Bench Telecom (AA)88.6%95.6%
AIME (Vals)96.3%
LiveCodeBench85.1%
MMLU-Pro89.9%
IOI47.1%
LegalBench85.3%
CorpFin66.1%
TaxEval75.3%
Terminal-Bench 2.1 (Vals)68.5%
SWE-bench (Vals)82.0%
GPQA Diamond (Vals)90.2%
Vals Index56.1
HiL-Bench41.7%
EQ-Bench 41311
Kagi LLM Benchmark73.3%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.