BenchLeader

Claude Opus 4.7 vs Gemini 3.8 Flash

Verdict
  • Claude Opus 4.7 leads on quality: 65.5 vs 63.5.
  • Claude Opus 4.7 is stronger in agents & tools, coding, composite, human preference, instruction following, maths, reasoning.
  • Gemini 3.8 Flash (medium) is stronger in knowledge, long context, multimodal.
  • Gemini 3.8 Flash (medium) is 6.7× cheaper ($1.50 vs $10.00 per 1M blended).
  • Gemini 3.8 Flash (medium) streams 5.9× faster (273 vs 46 tokens per second).
MetricClaude Opus 4.7Gemini 3.8 Flash (medium)
BenchLeader Index65.563.5
Agents & tools score69.4
Coding score64.863.6
Composite score80.379.4
Human preference score68.8
Instruction following score58.5
Knowledge score66.477.6
Long context score65.968.7
Maths score65.2
Multimodal score65.768.9
Reasoning score66.3
Blended price $/M$10.00$1.50
Output speed46 tok/s273 tok/s
Time to first answer21.2 s13.8 s
Context window1M1M
Humanity's Last Exam36.2%
Terminal-Bench80.2%
SimpleBench61.7%
SciCode54.4%
WeirdML76.4%
FrontierCode38.5%
GSO-Bench44.1%
Epoch Capabilities Index156.3
LMArena Text1495
LMArena Hard Prompts1519
LMArena Coding1547
LMArena WebDev1557
LMArena Vision1317
AA Intelligence Index40.740
IFBench58.6%
AA-LCR78.7%84.0%
MMMU-Pro78.8%84.2%
AA-Omniscience27.328.6
Terminal-Bench Hard51.5%
GPQA Diamond (AA)91.4%93.5%
Humanity's Last Exam (AA)42.3%42.1%
SciCode (AA)55.1%
τ²-Bench Telecom (AA)88.6%
AIME (Vals)96.3%
LiveCodeBench85.1%
MMLU-Pro89.9%
IOI47.1%
LegalBench85.3%
CorpFin66.1%
TaxEval75.3%
Terminal-Bench 2.1 (Vals)68.5%
SWE-bench (Vals)82.0%
GPQA Diamond (Vals)90.2%
Vals Index56.1
HiL-Bench41.7%
EQ-Bench 41311
Kagi LLM Benchmark73.3%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.