BenchLeader

Gemini 3.8 Flash vs GPT-5.4

Verdict
  • Gemini 3.8 Flash (medium) and GPT-5.4 are level on quality (63.5 vs 63.4).
  • Gemini 3.8 Flash (medium) is stronger in coding, composite, knowledge, long context, multimodal.
  • GPT-5.4 is stronger in agents & tools, human preference, instruction following, reasoning.
  • Gemini 3.8 Flash (medium) is 3.8× cheaper ($1.50 vs $5.63 per 1M blended).
  • Gemini 3.8 Flash (medium) streams 2.1× faster (273 vs 130 tokens per second).
MetricGemini 3.8 Flash (medium)GPT-5.4
BenchLeader Index63.563.4
Coding score63.651.6
Composite score79.478.1
Knowledge score77.666.8
Long context score68.767.6
Multimodal score68.964.0
Agents & tools score66.1
Human preference score64.5
Instruction following score71.7
Reasoning score62.3
Blended price $/M$1.50$5.63
Output speed273 tok/s130 tok/s
Time to first answer13.8 s126.4 s
Context window1M1.1M
Terminal-Bench81.8%
SciCode54.4%
APEX-Agents34.9%
Epoch Capabilities Index156.9
LMArena Text1466
LMArena Hard Prompts1488
LMArena Coding1514
LMArena WebDev1386
LMArena Vision1293
AA Intelligence Index4039.0
IFBench74.0%
AA-LCR84.0%82.0%
MMMU-Pro84.2%78.4%
AA-Omniscience28.65.8
Terminal-Bench Hard57.6%
GPQA Diamond (AA)93.5%92.0%
Humanity's Last Exam (AA)42.1%43.7%
SciCode (AA)55.1%
τ²-Bench Telecom (AA)87.1%
HiL-Bench9.7%
EQ-Bench 41272
Kagi LLM Benchmark63.8%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.