BenchLeader

Claude Opus 4.8 vs GPT-5.6 Sol

Verdict
  • GPT-5.6 Sol (high) leads on quality: 68.0 vs 64.7.
  • Claude Opus 4.8 is stronger in human preference, reasoning.
  • GPT-5.6 Sol (high) is stronger in agents & tools, coding, composite, instruction following, knowledge, long context, multimodal.
  • GPT-5.6 Sol (high) is 1.3× cheaper ($8.00 vs $10.00 per 1M blended).
MetricClaude Opus 4.8GPT-5.6 Sol (high)
BenchLeader Index64.768.0
Agents & tools score65.087.6
Coding score65.772.0
Composite score81.982.5
Human preference score65.6
Instruction following score61.667.6
Knowledge score66.373.7
Long context score65.367.4
Multimodal score64.466.5
Reasoning score64.262.9
Blended price $/M$10.00$8.00
Output speed58 tok/s59 tok/s
Time to first answer29.5 s31.4 s
Context window1M1M
SimpleBench64.8%
SciCode56.9%
Remote Labor Index8.3%
WeirdML88.8%
FrontierCode46.5%
GSO-Bench47.1%
Epoch Capabilities Index158.3
LMArena Text1473
LMArena Hard Prompts1503
LMArena Coding1527
LMArena WebDev1540
LMArena Vision1289
AA Intelligence Index42.042.5
IFBench62.2%69.2%
AA-LCR77.7%81.7%
MMMU-Pro81.8%
AA-Omniscience28.820.4
Terminal-Bench Hard58.3%62.1%
GPQA Diamond (AA)92.0%92.8%
Humanity's Last Exam (AA)48.7%46.0%
SciCode (AA)54.4%57.8%
τ²-Bench Telecom (AA)94.4%83.3%
LiveCodeBench87.8%
MMLU-Pro89.6%
LegalBench83.6%
CorpFin66.7%
TaxEval75.6%
Terminal-Bench 2.1 (Vals)71.9%
SWE-bench (Vals)88.6%
GPQA Diamond (Vals)92.4%
Vals Index60.9
EnigmaEval37.1%
HiL-Bench35.3%
EQ-Bench 41281
ARC-AGI-197.0%
ARC-AGI-285.4%
ARC-AGI-32.2%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.