BenchLeader

GPT-5.6 Sol vs Grok 4.5

Verdict
  • GPT-5.6 Sol (high) leads on quality: 68.0 vs 63.4.
  • GPT-5.6 Sol (high) is stronger in agents & tools, coding, composite, instruction following, long context, multimodal.
  • Grok 4.5 is stronger in knowledge, reasoning, human preference.
  • Grok 4.5 is 2.7× cheaper ($3.00 vs $8.00 per 1M blended).
MetricGPT-5.6 Sol (high)Grok 4.5
BenchLeader Index68.063.4
Agents & tools score87.658.6
Coding score72.059.9
Composite score82.566.0
Instruction following score67.6
Knowledge score73.776.0
Long context score67.466.2
Multimodal score66.564.8
Reasoning score62.968.9
Human preference score66.9
Blended price $/M$8.00$3.00
Output speed59 tok/s56 tok/s
Time to first answer31.4 s12.7 s
Context window1M500k
SimpleBench70.0%
SciCode56.9%
WeirdML88.8%46.4%
APEX-Agents34.2%
FrontierCode42.4%
Epoch Capabilities Index153.9
LMArena Text1471
LMArena Hard Prompts1495
LMArena Coding1523
LMArena WebDev1556
LMArena Vision1291
LMArena Agent3.9
LiveBench75.8%
LiveBench Reasoning87.2%
LiveBench Coding68.6%
LiveBench Agentic Coding56.5%
LiveBench Mathematics90.8%
LiveBench Data Analysis73.0%
LiveBench Language82.8%
AA Intelligence Index42.539.1
IFBench69.2%
AA-LCR81.7%79.3%
MMMU-Pro81.8%80.4%
AA-Omniscience20.425.3
Terminal-Bench Hard62.1%
GPQA Diamond (AA)92.8%93.1%
Humanity's Last Exam (AA)46.0%42.7%
SciCode (AA)57.8%55.0%
τ²-Bench Telecom (AA)83.3%
EnigmaEval37.1%
Kagi LLM Benchmark83.5%
ARC-AGI-197.0%
ARC-AGI-285.4%
ARC-AGI-32.2%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.