BenchLeader

Claude Opus 4.7 vs GPT-5.6 Sol

Verdict
  • GPT-5.6 Sol (high) leads on quality: 68.0 vs 65.5.
  • Claude Opus 4.7 is stronger in human preference, maths, reasoning.
  • GPT-5.6 Sol (high) is stronger in agents & tools, coding, composite, instruction following, knowledge, long context, multimodal.
  • GPT-5.6 Sol (high) is 1.3× cheaper ($8.00 vs $10.00 per 1M blended).
MetricClaude Opus 4.7GPT-5.6 Sol (high)
BenchLeader Index65.568.0
Agents & tools score69.487.6
Coding score64.872.0
Composite score80.382.5
Human preference score68.8
Instruction following score58.567.6
Knowledge score66.473.7
Long context score65.967.4
Maths score65.2
Multimodal score65.766.5
Reasoning score66.362.9
Blended price $/M$10.00$8.00
Output speed46 tok/s59 tok/s
Time to first answer21.2 s31.4 s
Context window1M1M
Humanity's Last Exam36.2%
Terminal-Bench80.2%
SimpleBench61.7%
SciCode56.9%
WeirdML76.4%88.8%
FrontierCode38.5%
GSO-Bench44.1%
Epoch Capabilities Index156.3
LMArena Text1495
LMArena Hard Prompts1519
LMArena Coding1547
LMArena WebDev1557
LMArena Vision1317
AA Intelligence Index40.742.5
IFBench58.6%69.2%
AA-LCR78.7%81.7%
MMMU-Pro78.8%81.8%
AA-Omniscience27.320.4
Terminal-Bench Hard51.5%62.1%
GPQA Diamond (AA)91.4%92.8%
Humanity's Last Exam (AA)42.3%46.0%
SciCode (AA)57.8%
τ²-Bench Telecom (AA)88.6%83.3%
AIME (Vals)96.3%
LiveCodeBench85.1%
MMLU-Pro89.9%
IOI47.1%
LegalBench85.3%
CorpFin66.1%
TaxEval75.3%
Terminal-Bench 2.1 (Vals)68.5%
SWE-bench (Vals)82.0%
GPQA Diamond (Vals)90.2%
Vals Index56.1
EnigmaEval37.1%
HiL-Bench41.7%
EQ-Bench 41311
Kagi LLM Benchmark73.3%
ARC-AGI-197.0%
ARC-AGI-285.4%
ARC-AGI-32.2%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.