BenchLeader
AlibabaOpen weights: Qwen/Qwen3-8BReasoning modelAuto-detected

Qwen3 8B

Best configuration ranks #528 of 610 on the BenchLeader Index at 39.5 ±3.9 (thinking reasoning effort). Released 28 Apr 2025.

Blended price
$0.660/M
$0.180 in · $2.10 out
Output speed
38 tok/s
First answer
56 s
first token 3.67 s
Context
131k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index40
  2. Agents & tools36
  3. Knowledge33
  4. Instruction following37
  5. Long context25
  6. Composite36

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Default” means the publisher did not say which setting was used.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning39 tok/s3.67 s$0.0001Maths 34 · Reasoning 37
thinkingbest39.5#52838 tok/s56 s$0.0007Agents & tools 36 · Composite 36 · Instruction following 37 · Knowledge 33 · Long context 25
default38.9#54039 tok/s3.67 s$0.0001Agents & tools 48 · Coding 20 · Composite 37 · Instruction following 33 · Knowledge 29 · Long context 25 · Maths 49 · Reasoning 43

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoningthinkingdefaultSource
GPQA Diamond47.5%#20856.8%#184Epoch AI Benchmarking Hub
GPQA Diamond (AA)not in index58.9%#36345.1%#428Artificial Analysis
Humanity's Last Exam (AA)not in index3.9%#4721.9%#523Artificial Analysis

Coding

Benchmarkno reasoningthinkingdefaultSource
SciCode22.6%#152SciCode
SciCode (AA)not in index27.9%#149Artificial Analysis

Agents & tools

Benchmarkno reasoningthinkingdefaultSource
Terminal-Bench Hard2.3%#3042.3%#304Artificial Analysis
τ²-Bench Telecom (AA)not in index27.8%#26424.9%#285Artificial Analysis
BFCL Overall42.6%#31Berkeley Function Calling Leaderboard

Maths

Benchmarkno reasoningthinkingdefaultSource
OTIS Mock AIME22.2%#20156.1%#155Epoch AI Benchmarking Hub

Knowledge

Benchmarkno reasoningthinkingdefaultSource
AA-Omniscience-64.7#420-74.0#447Artificial Analysis

Instruction following

Benchmarkno reasoningthinkingdefaultSource
IFBench33.5%#31228.6%#353Artificial Analysis

Long context

Benchmarkno reasoningthinkingdefaultSource
AA-LCR0.0%#4190.0%#419Artificial Analysis

Composite

Benchmarkno reasoningthinkingdefaultSource
Epoch Capabilities Indexnot in index136.2#113Epoch AI Benchmarking Hub
AA Intelligence Index5.2#5116.0#461Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Alibaba Cloud Int.34 tok/s0.81 s$0.117$0.455131k

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.00071.1 min
Summarise a 30-page report12,000 / 600$0.00341.2 min
Code edit6,000 / 1,500$0.00421.6 min
Agentic coding session60,000 / 4,000$0.0192.7 min
Structured extraction2,000 / 200$0.00081.0 min

See also

Data as of 9 Sept 2026. Compare these configurations.