BenchLeader

Claude Opus 4.6 vs Gemini 3.8 Flash

Verdict
  • Claude Opus 4.6 and Gemini 3.8 Flash (medium) are level on quality (63.1 vs 63.5).
  • Claude Opus 4.6 is stronger in agents & tools, human preference, instruction following, maths, reasoning.
  • Gemini 3.8 Flash (medium) is stronger in coding, composite, knowledge, long context, multimodal.
  • Gemini 3.8 Flash (medium) is 6.7× cheaper ($1.50 vs $10.00 per 1M blended).
  • Gemini 3.8 Flash (medium) streams 7.2× faster (273 vs 38 tokens per second).
MetricClaude Opus 4.6Gemini 3.8 Flash (medium)
BenchLeader Index63.163.5
Agents & tools score68.8
Coding score62.363.6
Composite score69.279.4
Human preference score64.6
Instruction following score53.7
Knowledge score70.577.6
Long context score65.568.7
Maths score65.6
Multimodal score63.668.9
Reasoning score62.3
Blended price $/M$10.00$1.50
Output speed38 tok/s273 tok/s
Time to first answer2.0 s13.8 s
Context window1M1M
GPQA Diamond90.5%
OTIS Mock AIME94.4%
SWE-bench Verified (Epoch)78.7%
Humanity's Last Exam19.0%
Terminal-Bench79.8%
SimpleBench67.6%
SciCode54.4%
Cybench93.0%
Remote Labor Index4.2%
WeirdML77.9%
APEX-Agents32.4%
FrontierCode26.6%
GSO-Bench33.3%
Epoch Capabilities Index155.3
LMArena Text1498
LMArena Hard Prompts1527
LMArena Coding1546
LMArena WebDev1537
LMArena Vision1311
AA Intelligence Index31.940
IFBench53.1%
AA-LCR78.0%84.0%
MMMU-Pro75.4%84.2%
AA-Omniscience13.728.6
Terminal-Bench Hard48.5%
GPQA Diamond (AA)89.6%93.5%
Humanity's Last Exam (AA)39.9%42.1%
SciCode (AA)55.1%
τ²-Bench Telecom (AA)92.1%
HiL-Bench38.3%
EQ-Bench 41223
Kagi LLM Benchmark72.4%
SWE-bench Verified (bash only)75.6%
SWE-bench Verified (any scaffold)75.6%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.