BenchLeader

GPT-5.4 vs Grok 4.6

Verdict
  • GPT-5.4 and Grok 4.6 (medium) are level on quality (63.4 vs 63.8).
  • GPT-5.4 is stronger in agents & tools, human preference, instruction following, long context, multimodal, reasoning.
  • Grok 4.6 (medium) is stronger in coding, composite, knowledge.
  • Grok 4.6 (medium) is 1.9× cheaper ($3.00 vs $5.63 per 1M blended).
  • GPT-5.4 streams 2.4× faster (130 vs 55 tokens per second).
MetricGPT-5.4Grok 4.6 (medium)
BenchLeader Index63.463.8
Agents & tools score66.1
Coding score51.663.9
Composite score78.183.2
Human preference score64.5
Instruction following score71.7
Knowledge score66.877.3
Long context score67.667.1
Multimodal score64.0
Reasoning score62.362.1
Blended price $/M$5.63$3.00
Output speed130 tok/s55 tok/s
Time to first answer126.4 s36.7 s
Context window1.1M500k
Terminal-Bench81.8%
SciCode54.6%
APEX-Agents34.9%
Epoch Capabilities Index156.9
LMArena Text1466
LMArena Hard Prompts1488
LMArena Coding1514
LMArena WebDev1386
LMArena Vision1293
AA Intelligence Index39.043.0
IFBench74.0%
AA-LCR82.0%81.0%
MMMU-Pro78.4%
AA-Omniscience5.828
Terminal-Bench Hard57.6%
GPQA Diamond (AA)92.0%93.5%
Humanity's Last Exam (AA)43.7%42.1%
SciCode (AA)55.9%
τ²-Bench Telecom (AA)87.1%
HiL-Bench9.7%
EQ-Bench 41272
Kagi LLM Benchmark63.8%
ARC-AGI-187.5%
ARC-AGI-261.3%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.