BenchLeader

DeepSeek V4 Pro vs GPT-6 Sol

Verdict
  • GPT-6 Sol (max) leads on quality: 67.7 vs 63.5.
  • DeepSeek V4 Pro (max) is stronger in agents & tools, coding, instruction following, maths.
  • GPT-6 Sol (max) is stronger in composite, knowledge, long context, reasoning, multimodal.
  • DeepSeek V4 Pro (max) is 7.4× cheaper ($0.544 vs $4.00 per 1M blended).
  • GPT-6 Sol (max) streams 1.5× faster (126 vs 86 tokens per second).
MetricDeepSeek V4 Pro (max)GPT-6 Sol (max)
BenchLeader Index63.567.7
Agents & tools score63.6
Coding score59.2
Composite score72.486.2
Instruction following score74.3
Knowledge score60.275.4
Long context score66.067.7
Maths score57.1
Reasoning score66.895.0
Multimodal score67.1
Blended price $/M$0.544$4.00
Output speed86 tok/s126 tok/s
Time to first answer52.5 s107.2 s
Context window1M1.1M
GPQA Diamond91.7%
FrontierMath Tiers 1–364.6%
FrontierMath Tier 426.8%
OTIS Mock AIME98.6%
SWE-bench Verified (Epoch)77.6%
SimpleQA Verified52.9%
SciCode51.0%
WeirdML66.2%
ProofBench16.0%
AA Intelligence Index3647.5
IFBench76.5%
AA-LCR80.3%83.7%
MMMU-Pro83.3%
AA-Omniscience0.827.1
Terminal-Bench Hard46.2%
GPQA Diamond (AA)92.8%
Humanity's Last Exam (AA)41.0%47.9%
SciCode (AA)51.0%57.6%
τ²-Bench Telecom (AA)96.2%
LiveCodeBench87.5%
MMLU-Pro87.3%
IOI51.6%
LegalBench82.4%
CorpFin65.4%
TaxEval73.1%
Terminal-Bench 2.1 (Vals)54.7%
SWE-bench (Vals)96.4%
GPQA Diamond (Vals)92.4%
Vals Index52.4
AIME 202696.7%
HMMT February 202693.9%
MathArena Apex28.1%
ARC-AGI-190.0%
ARC-AGI-261.3%
CritPt18.0%30.9%
GDPval (AA)47.1%49.4%
τ²-Bench Banking (AA)39.6%
ITBench SRE (AA)38.3%
Analyst Agent (AA)18.8%
APEX-Agents (AA)24.3%
CaseLaw v259.4%
Code Migration41.5%
Excel Modeling Benchmark52.8%
Finance Agent v250.4%
Harvey's Legal Agent Benchmark7.5%
Legal Research Bench40.9%
MedCode42.5%
MedScribe80.2%
ProgramBench0.0%
Public Benefits Bench62.9%
SkillsBench53.8%
Tax Agent Bench58.7%
Terminal-Bench 4.0 (Vals)1.0%
Terminal-Bench Science0.0%
Vibe Code Bench 1-10017.5%
Vibe Code Bench v1.182.3%
Chess Puzzles47.0%
Mystery Game Puzzles43.0%
LMCA41.2%
DTBench90.7%
ALE-Bench1403.2
Terminal-Bench 4.0 (AA)14.7%43.9%
Terminal-Bench 2.1 (AA)78.7%
AutomationBench56.7%61.6%
GDP.pdf11.4%24.8%
MLCR17.8%16.1%
EnterpriseOps-Gym49.6%
AA-Omniscience: accuracy49.1%54.5%
AA-Omniscience: non-hallucination5.9%39.9%
AA-Briefcase12611483
AA Openness Index44.4

Data as of 2026-09-23. Best configuration of each model; every score links to its source on the model pages.

DeepSeek V4 Pro vs GPT-6 Sol: questions

Is DeepSeek V4 Pro better than GPT-6 Sol?
GPT-6 Sol (max) leads on quality: 67.7 vs 63.5. The BenchLeader Index combines every independent quality benchmark; GPT-6 Sol (max) is ahead overall as of 2026-09-23, but check the category scores for your use.
Which is cheaper, DeepSeek V4 Pro or GPT-6 Sol?
DeepSeek V4 Pro is cheaper: $0.544 against $4.00 per million tokens, blended at three input tokens per output token.
Which is faster, DeepSeek V4 Pro or GPT-6 Sol?
GPT-6 Sol streams faster: 126 against 86 output tokens per second.
Which has the larger context window?
GPT-6 Sol accepts more context: 1.1M against 1M tokens.