BenchLeader

DeepSeek V4 Pro vs GPT-6.1 Sol

Verdict
  • GPT-6.1 Sol (max) leads on quality: 69.3 vs 62.8.
  • DeepSeek V4 Pro (max) is stronger in instruction following.
  • GPT-6.1 Sol (max) is stronger in agents & tools, coding, composite, knowledge, long context, maths, reasoning, human preference, multimodal.
  • DeepSeek V4 Pro (max) is 2.0× cheaper ($1.98 vs $4.00 per 1M blended).
  • DeepSeek V4 Pro (max) streams 1.7× faster (93 vs 56 tokens per second).
MetricDeepSeek V4 Pro (max)GPT-6.1 Sol (max)
BenchLeader Index62.869.3
Agents & tools score63.763.9
Coding score58.372.4
Composite score70.379.0
Instruction following score74.3–
Knowledge score59.878.8
Long context score65.466.8
Maths score56.372.5
Reasoning score65.276.4
Human preference score–68.1
Multimodal score–66.2
Blended price $/M$1.98$4.00
Output speed93 tok/s56 tok/s
Time to first answer48.9 s326.9 s
Context window1M1.1M
GPQA Diamond91.7%95.4%
FrontierMath Tiers 1–364.6%93.7%
FrontierMath Tier 426.8%100.0%
OTIS Mock AIME98.6%100.0%
SWE-bench Verified (Epoch)77.6%–
SimpleQA Verified52.9%73.9%
Terminal-Bench–58.2%
SciCode51.0%54.2%
WeirdML66.2%–
APEX-Agents–60.0%
ProofBench16.0%–
LMArena Text–1484
LMArena Hard Prompts–1507
LMArena Coding–1545
LMArena WebDev–1755
LMArena Vision–1288
LMArena Agent–11.7
LiveBench–81.6%
LiveBench Reasoning–92.6%
LiveBench Coding–80.4%
LiveBench Agentic Coding–54.5%
LiveBench Mathematics–96.8%
LiveBench Data Analysis–82.7%
LiveBench Language–90.1%
LiveBench Instruction Following–74.2%
AA Intelligence Index v4.3.23651.8
IFBench76.5%–
AA-LCR80.3%83.0%
MMMU-Pro–86.0%
AA-Omniscience0.841.5
Terminal-Bench Hard46.2%–
GPQA Diamond (AA)92.8%–
Humanity's Last Exam (AA)41.0%52.9%
SciCode (AA)51.0%54.2%
τ²-Bench Telecom (AA)96.2%–
LiveCodeBench87.5%–
MMLU-Pro87.3%–
IOI51.6%96.9%
LegalBench82.4%–
CorpFin65.4%–
TaxEval73.1%–
Terminal-Bench 2.1 (Vals)54.7%–
SWE-bench (Vals)96.4%–
GPQA Diamond (Vals)92.4%–
Vals Index47.661.1
AIME 202696.7%–
HMMT February 202693.9%–
MathArena Apex28.1%–
ARC-AGI-190.0%96.5%
ARC-AGI-261.3%94.2%
ARC-AGI-3–96.2%
CritPt18.0%31.7%
GDPval-AA v2.147.5%53.8%
τ³-Banking (AA)39.6%–
ITBench SRE (AA)38.3%–
Analyst Agent (AA)18.8%50.0%
APEX-Agents (AA)24.3%–
BioMysteryBench–79.6%
CaseLaw v259.4%–
Code Migration41.5%65.1%
CyberBench72.9%39.3%
Excel Modeling Benchmark52.8%70.8%
Finance Agent v250.4%52.0%
Harvey's Legal Agent Benchmark7.5%5.4%
Legal Research Bench40.9%38.5%
MedCode42.5%48.8%
MedScribe80.2%86.5%
MysteryMechanism–46.4%
ProgramBench0.0%–
Public Benefits Bench62.9%59.3%
SAGE–46.5%
SkillsBench53.8%–
SREBench–50.8%
Tax Agent Bench58.7%62.3%
Terminal-Bench 4.0 (Vals)14.1%55.0%
Terminal-Bench Science0.0%–
Vibe Code Bench 1-10017.5%–
Vibe Code Bench v1.182.3%88.9%
LMArena Maths–1488
LMArena Creative Writing–1462
LMArena Instruction Following–1488
LMArena Multi-turn–1487
LMArena Longer Queries–1496
Chess Puzzles47.0%61.0%
EBR-bench–54.3%
Mystery Game Puzzles43.0%80.0%
LMCA41.2%–
DTBench90.7%–
ALE-Bench1403.2–
Terminal-Bench 4.0 (AA)14.7%56.1%
Terminal-Bench 2.1 (AA)78.7%–
AutomationBench56.7%64.9%
GDP.pdf11.4%31.0%
MLCR17.8%33.9%
Harvey LAB–6.9%
EnterpriseOps-Gym49.6%–
AA-Omniscience: accuracy49.1%62.1%
AA-Omniscience: non-hallucination5.9%45.7%
AA-Briefcase v1.112571557
AA Openness Index44.4–

Data as of 2026-10-11. Best configuration of each model; every score links to its source on the model pages.

DeepSeek V4 Pro vs GPT-6.1 Sol: questions

Is DeepSeek V4 Pro better than GPT-6.1 Sol?
GPT-6.1 Sol (max) leads on quality: 69.3 vs 62.8. The BenchLeader Index combines every independent quality benchmark; GPT-6.1 Sol (max) is ahead overall as of 2026-10-11, but check the category scores for your use.
Is DeepSeek V4 Pro better than GPT-6.1 Sol for coding?
GPT-6.1 Sol scores higher in coding (72 vs 58 on the category index, where 50 is average).
Is DeepSeek V4 Pro better than GPT-6.1 Sol for agentic tasks?
GPT-6.1 Sol scores higher in agentic tasks (64 vs 64 on the category index, where 50 is average).
Which is cheaper, DeepSeek V4 Pro or GPT-6.1 Sol?
DeepSeek V4 Pro is cheaper: $1.98 against $4.00 per million tokens, blended at three input tokens per output token.
Which is faster, DeepSeek V4 Pro or GPT-6.1 Sol?
DeepSeek V4 Pro streams faster: 93 against 56 output tokens per second.
Which has the larger context window?
GPT-6.1 Sol accepts more context: 1.1M against 1M tokens.