BenchLeader

GPT-5.6 Sol vs GPT-6 Astra

Verdict
  • GPT-6 Astra (max) leads on quality: 70.6 vs 68.0.
  • GPT-5.6 Sol (high) is stronger in agents & tools, composite, instruction following, long context, multimodal.
  • GPT-6 Astra (max) is stronger in coding, knowledge, reasoning, maths.
  • GPT-5.6 Sol (high) is 2.8× cheaper ($8.00 vs $22.00 per 1M blended).
MetricGPT-5.6 Sol (high)GPT-6 Astra (max)
BenchLeader Index68.070.6
Agents & tools score87.668.2
Coding score72.079.0
Composite score82.573.1
Instruction following score67.6
Knowledge score73.779.8
Long context score67.4
Multimodal score66.5
Reasoning score62.970.9
Maths score77.0
Blended price $/M$8.00$22.00
Output speed59 tok/s54 tok/s
Time to first answer31.4 s328.6 s
Context window1M1.1M
GPQA Diamond95.8%
FrontierMath Tiers 1–393.7%
FrontierMath Tier 497.6%
OTIS Mock AIME100.0%
SimpleQA Verified75.6%
Terminal-Bench58.2%
SciCode56.9%56.5%
WeirdML88.8%
FrontierCode53.3%
LMArena WebDev1796
LMArena Agent12.5
LiveBench82.2%
LiveBench Reasoning92.7%
LiveBench Coding80.4%
LiveBench Agentic Coding57.3%
LiveBench Mathematics96.8%
LiveBench Data Analysis83.0%
LiveBench Language89.4%
AA Intelligence Index42.5
IFBench69.2%
AA-LCR81.7%
MMMU-Pro81.8%
AA-Omniscience20.4
Terminal-Bench Hard62.1%
GPQA Diamond (AA)92.8%
Humanity's Last Exam (AA)46.0%
SciCode (AA)57.8%
τ²-Bench Telecom (AA)83.3%
Terminal-Bench 2.1 (Vals)87.3%
Vals Index66.6
EnigmaEval37.1%
ARC-AGI-197.0%97.5%
ARC-AGI-285.4%95.0%
ARC-AGI-32.2%62.7%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.