BenchLeader

Gemini 3.5 Flash vs GPT-5.4 Pro

Verdict
  • Gemini 3.5 Flash (medium) and GPT-5.4 Pro are level on quality (63.9 vs 64.2).
  • Gemini 3.5 Flash (medium) is stronger in agents & tools, coding, composite, human preference, instruction following, knowledge, long context.
  • GPT-5.4 Pro is stronger in multimodal, reasoning.
  • Gemini 3.5 Flash (medium) is 20× cheaper ($3.38 vs $67.50 per 1M blended).
  • Gemini 3.5 Flash (medium) streams 208.9× faster (209 vs 1 tokens per second).
MetricGemini 3.5 Flash (medium)GPT-5.4 Pro
BenchLeader Index63.964.2
Agents & tools score67.8
Coding score58.9
Composite score71.4
Human preference score67.4
Instruction following score72.267.3
Knowledge score73.973.2
Long context score63.6
Multimodal score67.669.8
Reasoning score66.875.1
Blended price $/M$3.38$67.50
Output speed209 tok/s1 tok/s
Time to first answer17.0 s6.7 s
Context window1M1.1M
Humanity's Last Exam44.3%
SimpleBench74.1%
Epoch Capabilities Index158.9
LMArena Text1476
LMArena Hard Prompts1493
LMArena Coding1503
LMArena WebDev1491
LMArena Vision1306
AA Intelligence Index33.6
IFBench74.6%
AA-LCR74.3%
MMMU-Pro83.9%
AA-Omniscience20.8
Terminal-Bench Hard39.4%
GPQA Diamond (AA)92.1%
Humanity's Last Exam (AA)41.3%
τ²-Bench Telecom (AA)95.6%
MultiChallenge69.2%
VISTA53.9%
MultiNRC62.3%
TutorBench56.6%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.