BenchLeader
AlibabaOpen weights: Qwen/Qwen3-14BReasoning modelAuto-detected

Qwen3 14B

Best configuration ranks #484 of 610 on the BenchLeader Index at 41.5 ±5.6 (thinking reasoning effort). Released 29 Apr 2025.

Blended price
$1.31/M
$0.350 in · $4.20 out
Output speed
59 tok/s
First answer
37 s
first token 2.69 s
Context
33k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index42
  2. Agents & tools37
  3. Knowledge41
  4. Instruction following43
  5. Long context25
  6. Composite37

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Default” means the publisher did not say which setting was used.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning59 tok/s2.69 s$0.0002Maths 35 · Reasoning 41
thinkingbest41.5#48459 tok/s37 s$0.0014Agents & tools 37 · Composite 37 · Instruction following 43 · Knowledge 41 · Long context 25
default40.7#50159 tok/s2.69 s$0.0002Agents & tools 48 · Coding 33 · Composite 37 · Instruction following 29 · Knowledge 33 · Long context 25 · Maths 53 · Reasoning 47

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoningthinkingdefaultSource
GPQA Diamond53.4%#19363.8%#173Epoch AI Benchmarking Hub
GPQA Diamond (AA)not in index60.4%#35447.0%#420Artificial Analysis
Humanity's Last Exam (AA)not in index4.5%#4174.1%#457Artificial Analysis
Kagi LLM Benchmark49.1%#86Kagi LLM Benchmark

Coding

Benchmarkno reasoningthinkingdefaultSource
SciCode31.6%#140SciCode
SciCode (AA)not in index30.7%#146Artificial Analysis

Agents & tools

Benchmarkno reasoningthinkingdefaultSource
Terminal-Bench Hard3.8%#2835.3%#263Artificial Analysis
τ²-Bench Telecom (AA)not in index34.5%#23132.2%#242Artificial Analysis
BFCL Overall41.0%#35Berkeley Function Calling Leaderboard

Maths

Benchmarkno reasoningthinkingdefaultSource
OTIS Mock AIME25.8%#19566.4%#137Epoch AI Benchmarking Hub

Knowledge

Benchmarkno reasoningthinkingdefaultSource
AA-Omniscience-49.0#308-66.7#427Artificial Analysis

Instruction following

Benchmarkno reasoningthinkingdefaultSource
IFBench40.5%#24723.9%#376Artificial Analysis

Long context

Benchmarkno reasoningthinkingdefaultSource
AA-LCR0.0%#4190.0%#419Artificial Analysis

Composite

Benchmarkno reasoningthinkingdefaultSource
Epoch Capabilities Indexnot in index138.3#106Epoch AI Benchmarking Hub
AA Intelligence Index6.4#4486.7#428Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
NextBit63 tok/s0.57 s$0.100$0.22041kint4
Alibaba Cloud Int.56 tok/s0.28 s$0.228$0.910131k
DeepInfra52 tok/s1.06 s$0.120$0.24041kfp8

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.001442.0 s
Summarise a 30-page report12,000 / 600$0.006747.1 s
Code edit6,000 / 1,500$0.00841.0 min
Agentic coding session60,000 / 4,000$0.0381.8 min
Structured extraction2,000 / 200$0.001540.2 s

See also

Data as of 9 Sept 2026. Compare these configurations.