BenchLeader

Gemini 3.1 Pro vs GPT-5.4 Pro

Verdict
  • Gemini 3.1 Pro and GPT-5.4 Pro are level on quality (63.9 vs 64.2).
  • Gemini 3.1 Pro is stronger in agents & tools, coding, composite, human preference, instruction following, long context, maths.
  • GPT-5.4 Pro is stronger in knowledge, multimodal, reasoning.
  • Gemini 3.1 Pro is 15× cheaper ($4.50 vs $67.50 per 1M blended).
  • Gemini 3.1 Pro streams 110.4× faster (110 vs 1 tokens per second).
MetricGemini 3.1 ProGPT-5.4 Pro
BenchLeader Index63.964.2
Agents & tools score63.7
Coding score59.8
Composite score67.2
Human preference score59.6
Instruction following score69.567.3
Knowledge score66.173.2
Long context score67.6
Maths score60.7
Multimodal score66.169.8
Reasoning score69.575.1
Blended price $/M$4.50$67.50
Output speed110 tok/s1 tok/s
Time to first answer30.5 s6.7 s
Context window1.0M1.1M
GPQA Diamond94.1%
FrontierMath Tiers 1–359.6%
FrontierMath Tier 426.8%
OTIS Mock AIME95.6%
Humanity's Last Exam46.4%44.3%
Terminal-Bench80.2%
SimpleBench79.6%74.1%
SciCode58.9%
WeirdML72.1%
APEX-Agents33.5%
ProofBench26.0%
GSO-Bench22.6%
Epoch Capabilities Index155158.9
LMArena Text1487
LMArena Hard Prompts1507
LMArena Coding1521
LMArena WebDev1447
LMArena Vision1295
LMArena Agent-5.3
AA Intelligence Index30.4
IFBench77.1%
AA-LCR82.0%
MMMU-Pro82.4%
AA-Omniscience31.9
Terminal-Bench Hard53.8%
GPQA Diamond (AA)94.1%
Humanity's Last Exam (AA)47.0%
SciCode (AA)58.7%
τ²-Bench Telecom (AA)95.6%
AIME 202698.3%
HMMT February 202694.7%
MathArena Apex60.9%
MultiChallenge71.4%69.2%
PRBench Finance41.9%
PRBench Legal44.0%
VISTA53.9%
MultiNRC64.7%62.3%
HiL-Bench35.3%
TutorBench53.0%56.6%
EQ-Bench 41142
ARC-AGI-198.0%
ARC-AGI-277.1%
ARC-AGI-30.4%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.