BenchLeader

GPT-5.4 Pro vs GPT-6 Sol

Verdict
  • GPT-6 Sol (max) leads on quality: 67.7 vs 64.0.
  • GPT-5.4 Pro is stronger in instruction following, multimodal.
  • GPT-6 Sol (max) is stronger in knowledge, reasoning, composite, long context.
  • GPT-6 Sol (max) is 17× cheaper ($4.00 vs $67.50 per 1M blended).
  • GPT-6 Sol (max) streams 84.0× faster (126 vs 2 tokens per second).
MetricGPT-5.4 ProGPT-6 Sol (max)
BenchLeader Index64.067.7
Instruction following score67.3
Knowledge score73.675.4
Multimodal score69.867.1
Reasoning score73.295.0
Composite score86.2
Long context score67.7
Blended price $/M$67.50$4.00
Output speed2 tok/s126 tok/s
Time to first answer5.1 s107.2 s
Context window1.1M1.1M
Humanity's Last Exam44.3%
SimpleBench74.1%
Epoch Capabilities Index159.1
AA Intelligence Index47.5
AA-LCR83.7%
MMMU-Pro83.3%
AA-Omniscience27.1
Humanity's Last Exam (AA)47.9%
SciCode (AA)57.6%
MultiChallenge69.2%
VISTA53.9%
MultiNRC62.3%
TutorBench56.6%
CritPt30.9%
GDPval (AA)49.4%
FORTRESS14.8%
MASK91.7%
Terminal-Bench 4.0 (AA)43.9%
AutomationBench61.6%
GDP.pdf24.8%
MLCR16.1%
AA-Omniscience: accuracy54.5%
AA-Omniscience: non-hallucination39.9%
AA-Briefcase1483

Data as of 2026-09-23. Best configuration of each model; every score links to its source on the model pages.

GPT-5.4 Pro vs GPT-6 Sol: questions

Is GPT-5.4 Pro better than GPT-6 Sol?
GPT-6 Sol (max) leads on quality: 67.7 vs 64.0. The BenchLeader Index combines every independent quality benchmark; GPT-6 Sol (max) is ahead overall as of 2026-09-23, but check the category scores for your use.
Which is cheaper, GPT-5.4 Pro or GPT-6 Sol?
GPT-6 Sol is cheaper: $4.00 against $67.50 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-5.4 Pro or GPT-6 Sol?
GPT-6 Sol streams faster: 126 against 2 output tokens per second.
Which has the larger context window?
Both accept 1.1M tokens of context.