BenchLeader

Gemini 3.5 Flash vs GPT-5.4

Verdict
  • Gemini 3.5 Flash (medium) and GPT-5.4 are level on quality (63.9 vs 63.4).
  • Gemini 3.5 Flash (medium) is stronger in agents & tools, coding, human preference, instruction following, knowledge, multimodal, reasoning.
  • GPT-5.4 is stronger in composite, long context.
  • Gemini 3.5 Flash (medium) is 1.7× cheaper ($3.38 vs $5.63 per 1M blended).
  • Gemini 3.5 Flash (medium) streams 1.6× faster (209 vs 130 tokens per second).
MetricGemini 3.5 Flash (medium)GPT-5.4
BenchLeader Index63.963.4
Agents & tools score67.866.1
Coding score58.951.6
Composite score71.478.1
Human preference score67.464.5
Instruction following score72.271.7
Knowledge score73.966.8
Long context score63.667.6
Multimodal score67.664.0
Reasoning score66.862.3
Blended price $/M$3.38$5.63
Output speed209 tok/s130 tok/s
Time to first answer17.0 s126.4 s
Context window1M1.1M
Terminal-Bench81.8%
APEX-Agents34.9%
Epoch Capabilities Index156.9
LMArena Text14761466
LMArena Hard Prompts14931488
LMArena Coding15031514
LMArena WebDev14911386
LMArena Vision13061293
AA Intelligence Index33.639.0
IFBench74.6%74.0%
AA-LCR74.3%82.0%
MMMU-Pro83.9%78.4%
AA-Omniscience20.85.8
Terminal-Bench Hard39.4%57.6%
GPQA Diamond (AA)92.1%92.0%
Humanity's Last Exam (AA)41.3%43.7%
τ²-Bench Telecom (AA)95.6%87.1%
HiL-Bench9.7%
EQ-Bench 41272
Kagi LLM Benchmark63.8%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.