BenchLeader

DeepSeek V4 Pro

Reasoning effort

DeepSeek V4 Pro is a DeepSeek open-weights model, released 13 Aug 2026. Its best configuration (max reasoning effort) ranks #72 of 756 on the BenchLeader Index at 62.9 ±3.3, in the upper half. The ± is the point: 147 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in instruction following (74) and lowest in maths (56). At $0.990 per million tokens blended it is mid-priced. Output speed of 107 tokens per second puts it faster than most, with a first answer in 42.6 s. It has been measured at 6 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 29 Sept 2026.

Blended price
$0.990/M
$0.660 in · $1.98 out
Output speed
107 tok/s
measured by Artificial Analysis
First answer
43 s
first token 2.35 s
Context
1M
Full answer
47 s
median, reasoning included
Cost per run
$0.674
one full Intelligence Index run
Released
13 Aug 2026
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index63
  2. Reasoning65
  3. Coding58
  4. Agents & tools64
  5. Maths56
  6. Knowledge60
  7. Instruction following74
  8. Long context66
  9. Composite71

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning49.4#382153 tok/s2.03 s$0.0009Agents & tools 65 · Coding 35 · Composite 53 · Instruction following 48 · Knowledge 56 · Long context 51 · Maths 44 · Reasoning 41
low––35 tok/s2.35 s$0.0009Reasoning 60
high56.6#185110 tok/s20 s$0.0009Agents & tools 57 · Coding 41 · Composite 64 · Instruction following 70 · Knowledge 57 · Long context 60 · Reasoning 59
xhigh––35 tok/s2.35 s$0.0009
maxbest62.9#72107 tok/s43 s$0.0009Agents & tools 64 · Coding 58 · Composite 71 · Instruction following 74 · Knowledge 60 · Long context 66 · Maths 56 · Reasoning 65
not stated53.9#25535 tok/s2.35 s$0.0009Agents & tools 43 · Coding 54 · Composite 57 · Human preference 58 · Maths 60 · Reasoning 57

How its index has moved

8 Sept 2026 to 5 Oct 2026
405468
  • max
  • high
  • not stated
  • no reasoning

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Metadata

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
AA Openness Indexnot in index––––44.4#26–Artificial Analysis

Reasoning

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
GPQA Diamond73.2%#152–––91.7%#28–Epoch AI Benchmarking Hub
LMArena Hard Prompts–––––1480#65LMArena
LiveBench Reasoningnot in index–––––85.8%#33LiveBench
GPQA Diamond (AA)not in index71.7%#278–90.5%#59–92.8%#28–Artificial Analysis
Humanity's Last Exam (AA)not in index10.6%#293–35.2%#106–41.0%#72–Artificial Analysis
GPQA Diamond (Vals)not in index––––92.4%#16–Vals AI
Kagi LLM Benchmark–––––53.5%#70Kagi LLM Benchmark
ARC-AGI-113.0%#19690.5%#6587.2%#79–90.0%#69–ARC Prize
ARC-AGI-20.8%#19656.3%#8359.7%#77–61.3%#72–ARC Prize
CritPt0.9%#217–10.0%#105–18.0%#63–Artificial Analysis
Chess Puzzlesnot in index7.0%#143–––47.0%#14–Epoch AI Benchmarking Hub
Mystery Game Puzzlesnot in index17.0%#70–––43.0%#13–Epoch AI Benchmarking Hub
LMCAnot in index––––41.2%#8645.5%#71Epoch AI Benchmarking Hub
DTBenchnot in index––––90.7%#6493.9%#47Epoch AI Benchmarking Hub
ForecastBenchnot in index–––––56.1%#68ForecastBench

Coding

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
SWE-bench Verified (Epoch)––––77.6%#6–Epoch AI Benchmarking Hub
SciCode39.9%#156–––51.0%#90–SciCode
WeirdML––––66.2%#39–WeirdML
FrontierCode17.6%#36–28.6%#29–––Cognition
LMArena Coding–––––1500#78LMArena
LMArena WebDev–––––1446#65LMArena
LiveBench Codingnot in index–––––77.2%#37LiveBench
SciCode (AA)not in index39.9%#159–––51.0%#90–Artificial Analysis
LiveCodeBench––––87.5%#13–Vals AI
IOI––––51.6%#22–Vals AI
SWE-bench (Vals)not in index––––96.4%#2–Vals AI
Code Migrationnot in index––––41.5%#24–Vals AI
ProgramBenchnot in index––––0.0%#23–Vals AI
Vibe Code Bench 1-100not in index––––17.5%#11–Vals AI
Vibe Code Bench v1.1not in index––––82.3%#17–Vals AI
SWE Atlas: Codebase QnAnot in index–––––27.1%#16Scale AI SEAL
SWE Atlas: Test Writingnot in index–––––27.1%#20Scale AI SEAL
ALE-Benchnot in index521.7#96–––1403.2#22–Epoch AI Benchmarking Hub
Terminal-Bench 4.0 (AA)not in index1.5%#106–––14.7%#60–Artificial Analysis
Terminal-Bench 2.1 (AA)not in index––64.8%#83–78.7%#49–Artificial Analysis

Agents & tools

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
APEX-Agents–––––47.3%#31Mercor
LMArena Agent––1.2#25–––LMArena
LiveBench Agentic Codingnot in index–––––55.0%#27LiveBench
Terminal-Bench Hard36.4%#71–41.7%#50–46.2%#30–Artificial Analysis
τ²-Bench Telecom (AA)not in index91.2%#59–94.2%#34–96.2%#15–Artificial Analysis
Terminal-Bench 2.1 (Vals)––––54.7%#4950.2%#57Vals AI
GDPval (AA)not in index27.6%#130–32.0%#115–47.1%#54–Artificial Analysis
τ²-Bench Banking (AA)––26.2%#75–39.6%#31–Artificial Analysis
ITBench SRE (AA)not in index––––38.3%#22–Artificial Analysis
Analyst Agent (AA)not in index––––18.8%#25–Artificial Analysis
APEX-Agents (AA)not in index––––24.3%#19–Artificial Analysis
CyberBenchnot in index––––72.9%#11–Vals AI
Finance Agent v2not in index––––50.4%#36–Vals AI
Harvey's Legal Agent Benchmarknot in index––––7.5%#21–Vals AI
Legal Research Benchnot in index––––40.9%#22–Vals AI
SkillsBenchnot in index––––53.8%#16–Vals AI
Tax Agent Benchnot in index––––58.7%#34–Vals AI
Terminal-Bench 2.0 (Vals)not in index–––––56.2%#14Vals AI
Terminal-Bench 4.0 (Vals)not in index––––14.1%#25–Vals AI
Terminal-Bench Sciencenot in index––––0.0%#29–Vals AI
Vending-Bench 2not in index–––––3284.5#45Andon Labs
AutomationBenchnot in index––––56.7%#28–Artificial Analysis
GDP.pdfnot in index––––11.4%#38–Artificial Analysis
EnterpriseOps-Gymnot in index––––49.6%#4–Artificial Analysis
AA-Briefcasenot in index––––1256#38–Artificial Analysis

Maths

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
FrontierMath Tiers 1–3––––64.6%#31–Epoch AI Benchmarking Hub
FrontierMath Tier 4––––26.8%#38–Epoch AI Benchmarking Hub
OTIS Mock AIME46.7%#178–––98.6%#19–Epoch AI Benchmarking Hub
ProofBench––––16.0%#5450.0%#28Vals AI
LiveBench Mathematicsnot in index–––––95.1%#16LiveBench
AIME 2026––––96.7%#6–MathArena
HMMT February 2026––––93.9%#10–MathArena
MathArena Apex––––28.1%#10–MathArena
LMArena Maths–––––1445#78LMArena

Knowledge

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
SimpleQA Verified––––52.9%#21–Epoch AI Benchmarking Hub
LiveBench Data Analysisnot in index–––––79.2%#17LiveBench
AA-Omniscience-12.4#194–-10.6#181–0.8#116–Artificial Analysis
MMLU-Pro––––87.3%#32–Vals AI
LegalBench––––82.4%#69–Vals AI
CorpFin––––65.4%#28–Vals AI
TaxEval––––73.1%#52–Vals AI
CaseLaw v2not in index––––59.4%#27–Vals AI
Excel Modeling Benchmarknot in index––––52.8%#44–Vals AI
MedCodenot in index––––42.5%#47–Vals AI
MedScribenot in index––––80.2%#54–Vals AI
Public Benefits Benchnot in index––––62.9%#21–Vals AI
DrugDiscoveryBenchnot in index–––31.7%#13––Scale AI SEAL
AA-Omniscience: accuracynot in index41.5%#108–41.4%#109–49.1%#65–Artificial Analysis
AA-Omniscience: non-hallucinationnot in index12.2%#360–11.3%#372–5.9%#489–Artificial Analysis

Instruction following

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
LiveBench Languagenot in index–––––82.1%#25LiveBench
LiveBench Instruction Followingnot in index–––––67.7%#34LiveBench
IFBench45.8%#198–71.3%#57–76.5%#20–Artificial Analysis
LMArena Instruction Followingnot in index–––––1452#62LMArena

Human preference

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
LMArena Text–––––1458#62LMArena
EQ-Bench 4–––––1166#17EQ-Bench
LMArena Creative Writingnot in index–––––1446#48LMArena
LMArena Multi-turnnot in index–––––1475#47LMArena
LMArena Longer Queriesnot in index–––––1472#58LMArena

Long context

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
AA-LCR53.0%#288–70.3%#195–80.3%#63–Artificial Analysis
MLCRnot in index––––17.8%#22–Artificial Analysis

Composite

Benchmarkno reasoninglowhighxhighmaxnot statedSourceTrend
Epoch Capabilities Indexnot in index–––––155.4#26Epoch AI Benchmarking Hub
LiveBench–––––77.4%#22LiveBench
AA Intelligence Index20.8#202–30.1#107–36#75–Artificial Analysis
Vals Indexnot in index––––47.6#30–Vals AI

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Relace79 tok/s0.92 s$0.207$4.201.0Mfp4
Azure57 tok/s1.63 s$1.91$3.831.0M–
NovitaAI54 tok/s2.48 s$1.60$3.201.0Mfp8
Baidu Qianfan52 tok/s1.05 s$1.69$3.381.0Mfp8
Parasail45 tok/s0.70 s$0.450$3.481.0Mfp8
AtlasCloud43 tok/s1.53 s$1.68$3.381.0Mfp4
NextBit43 tok/s4.21 s$1.74$3.481.0Mfp8
Alibaba Cloud Int.43 tok/s1.82 s$1.42$2.831Mfp8
Cloudflare42 tok/s2.64 s$1.15$2.551.0M–
DeepInfra39 tok/s1.46 s$1.30$2.601.0Mfp8
SiliconFlow39 tok/s2.27 s$1.50$3.131.0Mfp8
Venice39 tok/s1.53 s$1.65$3.301M–
StreamLake39 tok/s2.87 s$0.209$0.4181.0Mfp8
Reka AI26 tok/s0.82 s$1.20$6.001.0M–
GMICloud20 tok/s2.95 s$0.957$1.911.0Mfp8
DigitalOcean12 tok/s2.47 s$1.04$2.091.0M–

Price history

Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.

$0.00$0.957$1.91$2.87$3.83May 26Jun 26Jul 26Aug 26Sept 26
input outputnow $0.209 in · $0.418 out

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.022 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0009$0.000745.5 s
Summarise a 30-page report12,000 / 600$0.0091$0.003448.3 s
Code edit6,000 / 1,500$0.0069$0.004156.7 s
Agentic coding session60,000 / 4,000$0.048$0.0191.3 min
Structured extraction2,000 / 200$0.0017$0.000844.5 s

See also

Data as of 5 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “DeepSeek V4 Pro: benchmarks, pricing, speed and rank”, https://www.benchleader.com/models/deepseek-v4-pro, data as of 5 Oct 2026.