BenchLeader

Qwen3 Max

Best configuration ranks #186 of 610 on the BenchLeader Index at 55.0 ±6.7 (thinking reasoning effort). Released 5 Sept 2025.

Blended price
$2.40/M
$1.20 in · $6.00 out
Output speed
58 tok/s
First answer
38 s
first token 4.28 s
Context
262k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index55
  2. Agents & tools55
  3. Knowledge47
  4. Instruction following69
  5. Long context64
  6. Composite56

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Default” means the publisher did not say which setting was used.

EffortIndexRankSpeedFirst answerChat reply costCategories
max52.7#24048 tok/s2.38 s$0.0014Agents & tools 51 · Coding 55 · Composite 49 · Human preference 61 · Instruction following 46 · Knowledge 55 · Long context 51 · Maths 52 · Reasoning 59
thinkingbest55.0#18658 tok/s38 s$0.0023Agents & tools 55 · Composite 56 · Instruction following 69 · Knowledge 47 · Long context 64
default51.8#26457 tok/s4.28 s$0.0023Agents & tools 51 · Coding 49 · Composite 45 · Human preference 63 · Instruction following 49 · Knowledge 50 · Long context 47 · Maths 52 · Reasoning 63

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarkmaxthinkingdefaultSource
GPQA Diamond72.6%#148Epoch AI Benchmarking Hub
LMArena Hard Prompts1447#971459#82LMArena
GPQA Diamond (AA)not in index76.4%#22686.1%#11376.4%#226Artificial Analysis
Humanity's Last Exam (AA)not in index11.9%#22428.0%#12010.2%#255Artificial Analysis
GPQA Diamond (Vals)not in index84.8%#4877.8%#73Vals AI
Kagi LLM Benchmark72.5%#22Kagi LLM Benchmark

Coding

BenchmarkmaxthinkingdefaultSource
LMArena Coding1474#981481#88LMArena
LiveCodeBench78.2%#7466.9%#94Vals AI
IOI15.7%#287.8%#35Vals AI

Agents & tools

BenchmarkmaxthinkingdefaultSource
Terminal-Bench Hard20.4%#15724.2%#13719.7%#160Artificial Analysis
τ²-Bench Telecom (AA)not in index74.3%#13683.6%#10532.8%#239Artificial Analysis

Maths

BenchmarkmaxthinkingdefaultSource
FrontierMath Tiers 1–318.9%#78Epoch AI Benchmarking Hub
OTIS Mock AIME73.3%#114Epoch AI Benchmarking Hub
MATH Level 597.1%#7Epoch AI Benchmarking Hub
AIME (Vals)81.0%#4660.7%#56Vals AI
MGSM91.8%#2592.2%#21Vals AI

Knowledge

BenchmarkmaxthinkingdefaultSource
SimpleQA Verified48.8%#25Epoch AI Benchmarking Hub
AA-Omniscience-43.5#277-36.6#241-42.8#273Artificial Analysis
MMLU-Pro85.0%#5883.5%#70Vals AI
LegalBench81.9%#7280.3%#80Vals AI
CorpFin68.0%#1153.0%#96Vals AI
TaxEval73.5%#4774.0%#42Vals AI
MedQA87.4%#5687.4%#55Vals AI

Instruction following

BenchmarkmaxthinkingdefaultSource
IFBench44.1%#21270.8%#6448.0%#183Artificial Analysis

Human preference

BenchmarkmaxthinkingdefaultSource
LMArena Text1424#1031435#87LMArena

Long context

BenchmarkmaxthinkingdefaultSource
AA-LCR50.0%#25374.3%#11643.0%#277Artificial Analysis

Composite

BenchmarkmaxthinkingdefaultSource
Epoch Capabilities Indexnot in index142.4#87Epoch AI Benchmarking Hub
AA Intelligence Index15.6#21321.3#16112.6#260Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Alibaba Cloud Int.33 tok/s1.11 s$0.780$3.90262k

Price history

Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.

$0.00$1.65$3.30$4.95$6.60Feb 26Mar 26Apr 26May 26Jun 26Jul 26Aug 26Sept 26
input outputnow $0.780 in · $3.90 out

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.002343.7 s
Summarise a 30-page report12,000 / 600$0.01848.8 s
Code edit6,000 / 1,500$0.0161.1 min
Agentic coding session60,000 / 4,000$0.0961.8 min
Structured extraction2,000 / 200$0.003641.9 s

See also

Data as of 9 Sept 2026. Compare these configurations.