BenchLeader

GPT-5.4 Pro vs Grok 4.5

Verdict
  • GPT-5.4 Pro and Grok 4.5 are level on quality (64.2 vs 63.4).
  • GPT-5.4 Pro is stronger in instruction following, multimodal, reasoning.
  • Grok 4.5 is stronger in knowledge, agents & tools, coding, composite, human preference, long context.
  • Grok 4.5 is 23× cheaper ($3.00 vs $67.50 per 1M blended).
  • Grok 4.5 streams 55.7× faster (56 vs 1 tokens per second).
MetricGPT-5.4 ProGrok 4.5
BenchLeader Index64.263.4
Instruction following score67.3
Knowledge score73.276.0
Multimodal score69.864.8
Reasoning score75.168.9
Agents & tools score58.6
Coding score59.9
Composite score66.0
Human preference score66.9
Long context score66.2
Blended price $/M$67.50$3.00
Output speed1 tok/s56 tok/s
Time to first answer6.7 s12.7 s
Context window1.1M500k
Humanity's Last Exam44.3%
SimpleBench74.1%70.0%
WeirdML46.4%
APEX-Agents34.2%
FrontierCode42.4%
Epoch Capabilities Index158.9153.9
LMArena Text1471
LMArena Hard Prompts1495
LMArena Coding1523
LMArena WebDev1556
LMArena Vision1291
LMArena Agent3.9
LiveBench75.8%
LiveBench Reasoning87.2%
LiveBench Coding68.6%
LiveBench Agentic Coding56.5%
LiveBench Mathematics90.8%
LiveBench Data Analysis73.0%
LiveBench Language82.8%
AA Intelligence Index39.1
AA-LCR79.3%
MMMU-Pro80.4%
AA-Omniscience25.3
GPQA Diamond (AA)93.1%
Humanity's Last Exam (AA)42.7%
SciCode (AA)55.0%
MultiChallenge69.2%
VISTA53.9%
MultiNRC62.3%
TutorBench56.6%
Kagi LLM Benchmark83.5%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.