BenchLeader

Qwen3.5-9B

Reasoning effort

Qwen3.5-9B is an Alibaba open-weights reasoning model, released 24 Feb 2026. Its best configuration (thinking reasoning effort) ranks #387 of 751 on the BenchLeader Index at 49.1 ±7.3, in the lower half. The ± is the point: 400 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in instruction following (66) and lowest in knowledge (38). At $0.113 per million tokens blended it is among the cheapest fifth of ranked models. Output speed of 52 tokens per second puts it slower than most, with a first answer in 40.8 s. It has been measured at 3 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them.

Blended price
$0.113/M
$0.100 in · $0.150 out
Output speed
52 tok/s
measured by Artificial Analysis
First answer
41 s
first token 0.74 s
Context
262k
Full answer
50 s
median, reasoning included
Cost per run
$0.213
one full Intelligence Index run
Released
24 Feb 2026
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index49
  2. Reasoning42
  3. Agents & tools41
  4. Knowledge38
  5. Instruction following66
  6. Multimodal52
  7. Long context60
  8. Composite42

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning46.5#46196 tok/s0.66 s$0.0001Agents & tools 49 · Composite 45 · Instruction following 41 · Knowledge 30 · Long context 48 · Maths 51 · Multimodal 50 · Reasoning 50
thinkingbest49.1#38752 tok/s41 s$0.0001Agents & tools 41 · Composite 42 · Instruction following 66 · Knowledge 38 · Long context 60 · Multimodal 52 · Reasoning 42
not stated40.1#63633 tok/s0.74 s$0.0001Agents & tools 24 · Coding 25 · Maths 37 · Reasoning 58

How its index has moved

9 Sept 2026 to 3 Oct 2026
334557
  • thinking
  • no reasoning
  • not stated

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoningthinkingnot statedSourceTrend
GPQA Diamond78.9%#125–79.0%#124Epoch AI Benchmarking Hub
GPQA Diamond (AA)not in index78.6%#20480.6%#186–Artificial Analysis
Humanity's Last Exam (AA)not in index9.4%#31514.9%#235–Artificial Analysis
CritPt0.6%#2340.3%#250–Artificial Analysis
Chess Puzzlesnot in index12.0%#123–2.0%#178Epoch AI Benchmarking Hub
LMCAnot in index––24.5%#129Epoch AI Benchmarking Hub
DTBenchnot in index––71.2%#134Epoch AI Benchmarking Hub

Coding

Benchmarkno reasoningthinkingnot statedSourceTrend
SciCode––27.6%#176SciCode
SciCode (AA)not in index–29.5%#193–Artificial Analysis
Terminal-Bench 4.0 (AA)not in index–0.5%#123–Artificial Analysis
Terminal-Bench 2.1 (AA)not in index21.4%#16629.2%#153–Artificial Analysis

Agents & tools

Benchmarkno reasoningthinkingnot statedSourceTrend
Terminal-Bench––9.2%#74Terminal-Bench
Terminal-Bench Hard18.2%#17024.2%#142–Artificial Analysis
τ²-Bench Telecom (AA)not in index85.1%#9386.8%#83–Artificial Analysis
GDPval (AA)not in index–0.0%#197–Artificial Analysis
τ²-Bench Banking (AA)–7.0%#160–Artificial Analysis

Maths

Benchmarkno reasoningthinkingnot statedSourceTrend
OTIS Mock AIME61.7%#154–42.8%#187Epoch AI Benchmarking Hub
AIME 2026––92.5%#23MathArena
HMMT February 2026––71.2%#29MathArena
MathArena Apex––0.5%#41MathArena

Knowledge

Benchmarkno reasoningthinkingnot statedSourceTrend
AA-Omniscience-70.7#491-53.5#395–Artificial Analysis
AA-Omniscience: accuracynot in index14.0%#42016.4%#365–Artificial Analysis
AA-Omniscience: non-hallucinationnot in index1.6%#52516.4%#310–Artificial Analysis

Instruction following

Benchmarkno reasoningthinkingnot statedSourceTrend
IFBench37.8%#28366.7%#90–Artificial Analysis

Multimodal

Benchmarkno reasoningthinkingnot statedSourceTrend
MMMU-Pro66.8%#16369.3%#148–Artificial Analysis

Long context

Benchmarkno reasoningthinkingnot statedSourceTrend
AA-LCR46.0%#31070.0%#199–Artificial Analysis

Composite

Benchmarkno reasoningthinkingnot statedSourceTrend
Epoch Capabilities Indexnot in index––139.5#107Epoch AI Benchmarking Hub
AA Intelligence Index13.3#29211.2#337–Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Venice122 tok/s1.06 s$0.100$0.150256kfp8
Parasail89 tok/s0.63 s$0.100$0.250262kbf16
Together68 tok/s1.55 s$0.170$0.250262k–
Darkbloom47 tok/s1.50 s$0.080$0.130262kfp4
SiliconFlow33 tok/s1.15 s$0.100$0.150262kfp8
DeepInfra13 tok/s1.29 s$0.100$0.150262kbf16

Price history

Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.

$0.00$0.036$0.072$0.107$0.143Sept 26
input outputnow $0.080 in · $0.130 out

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0001–46.6 s
Summarise a 30-page report12,000 / 600$0.0013–52.4 s
Code edit6,000 / 1,500$0.0008–1.2 min
Agentic coding session60,000 / 4,000$0.0066–2.0 min
Structured extraction2,000 / 200$0.0002–44.7 s

See also

Data as of 4 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “Qwen3.5-9B: benchmarks, pricing, speed and rank”, https://www.benchleader.com/models/qwen3-5-9b, data as of 4 Oct 2026.