BenchLeader

Gemini 3.7 Flash vs GPT-5.4

Verdict
  • Gemini 3.7 Flash (medium) leads on quality: 64.4 vs 63.4.
  • Gemini 3.7 Flash (medium) is stronger in coding, composite, knowledge, long context, multimodal, reasoning.
  • GPT-5.4 is stronger in agents & tools, human preference, instruction following.
  • Gemini 3.7 Flash (medium) is 3.8× cheaper ($1.50 vs $5.63 per 1M blended).
  • Gemini 3.7 Flash (medium) streams 2.2× faster (282 vs 130 tokens per second).
MetricGemini 3.7 Flash (medium)GPT-5.4
BenchLeader Index64.463.4
Coding score68.351.6
Composite score78.978.1
Knowledge score75.266.8
Long context score68.167.6
Multimodal score69.464.0
Reasoning score63.562.3
Agents & tools score66.1
Human preference score64.5
Instruction following score71.7
Blended price $/M$1.50$5.63
Output speed282 tok/s130 tok/s
Time to first answer5.3 s126.4 s
Context window1M1.1M
Terminal-Bench81.8%
SciCode57.9%
APEX-Agents34.9%
Epoch Capabilities Index156.9
LMArena Text1466
LMArena Hard Prompts1488
LMArena Coding1514
LMArena WebDev1386
LMArena Vision1293
AA Intelligence Index39.639.0
IFBench74.0%
AA-LCR83.0%82.0%
MMMU-Pro84.7%78.4%
AA-Omniscience23.75.8
Terminal-Bench Hard57.6%
GPQA Diamond (AA)92.1%92.0%
Humanity's Last Exam (AA)39.0%43.7%
SciCode (AA)59.8%
τ²-Bench Telecom (AA)87.1%
HiL-Bench9.7%
EQ-Bench 41272
Kagi LLM Benchmark63.8%
ARC-AGI-191.2%
ARC-AGI-263.8%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.