BenchLeader

DeepSeek V3.1

Best configuration ranks #190 of 610 on the BenchLeader Index at 54.8 ±4.2 (thinking reasoning effort). Last measured 2 Sept 2026. Released 21 Aug 2025.

Blended price
$1.92/M
$1.64 in · $2.75 out
Output speed
29 tok/s
First answer
1.81 s
Context
128k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index55
  2. Reasoning61
  3. Coding51
  4. Agents & tools60
  5. Knowledge52
  6. Instruction following57
  7. Human preference60
  8. Long context61
  9. Composite48

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Default” means the publisher did not say which setting was used.

EffortIndexRankSpeedFirst answerChat reply costCategories
thinkingbest54.8#19029 tok/s1.81 s$0.0015Agents & tools 60 · Coding 51 · Composite 48 · Human preference 60 · Instruction following 57 · Knowledge 52 · Long context 61 · Reasoning 61
default51.0#27229 tok/s1.81 s$0.0004Agents & tools 61 · Coding 51 · Composite 47 · Human preference 60 · Instruction following 43 · Knowledge 43 · Long context 48 · Reasoning 56

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarkthinkingdefaultSourceTrend
LMArena Hard Prompts1446#991423#124LMArena
GPQA Diamond (AA)not in index79.2%#19475.0%#243Artificial Analysis
Humanity's Last Exam (AA)not in index16.4%#1848.7%#279Artificial Analysis
Kagi LLM Benchmark57.4%#59Kagi LLM Benchmark

Coding

BenchmarkthinkingdefaultSourceTrend
SciCode40.6%#104SciCode
WeirdML38.4%#110WeirdML
LMArena Coding1461#1111440#137LMArena
SciCode (AA)not in index38.0%#126Artificial Analysis

Agents & tools

BenchmarkthinkingdefaultSourceTrend
Terminal-Bench Hard30.3%#11031.8%#99Artificial Analysis
τ²-Bench Telecom (AA)not in index37.4%#22037.1%#222Artificial Analysis

Knowledge

BenchmarkthinkingdefaultSourceTrend
AA-Omniscience-26.4#202-43.5#276Artificial Analysis

Instruction following

BenchmarkthinkingdefaultSourceTrend
IFBench57.0%#13741.2%#244Artificial Analysis

Human preference

BenchmarkthinkingdefaultSourceTrend
LMArena Text1418#1091415#112LMArena

Long context

BenchmarkthinkingdefaultSourceTrend
AA-LCR69.3%#17045.3%#268Artificial Analysis

Composite

BenchmarkthinkingdefaultSourceTrend
AA Intelligence Index15.4#21713.9#236Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
StreamLake46 tok/s1.70 s$0.343$1.03128k
AtlasCloud36 tok/s1.93 s$0.300$0.950131kfp8
NovitaAI21 tok/s2.21 s$0.270$1.00131kfp8
SiliconFlow18 tok/s1.38 s$0.270$1.00164kfp8

Price history

Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.

$0.00$0.261$0.522$0.784$1.04Jan 26Feb 26Mar 26Apr 26May 26Jun 26Jul 26Aug 26
input outputnow $0.250 in · $0.950 out

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.135 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0015$0.001012.3 s
Summarise a 30-page report12,000 / 600$0.021$0.007822.9 s
Code edit6,000 / 1,500$0.014$0.007254.4 s
Agentic coding session60,000 / 4,000$0.109$0.0422.4 min
Structured extraction2,000 / 200$0.0038$0.00168.8 s

See also

Data as of 9 Sept 2026. Compare these configurations.