BenchLeader

Qwen3.5 27B

Best configuration ranks #177 of 610 on the BenchLeader Index at 55.4 ±5.3. Last measured 8 Sept 2026. Released 24 Feb 2026.

Blended price
$0.825/M
$0.300 in · $2.40 out
Output speed
76 tok/s
First answer
32 s
first token 0.90 s
Context
262k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index55
  2. Reasoning59
  3. Coding46
  4. Agents & tools62
  5. Maths41
  6. Knowledge43
  7. Instruction following73
  8. Human preference59
  9. Multimodal59
  10. Long context65
  11. Composite58

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Default” means the publisher did not say which setting was used.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning51.9#26281 tok/s5.65 s$0.0008Agents & tools 61 · Composite 53 · Instruction following 48 · Knowledge 42 · Long context 58 · Multimodal 54
defaultbest55.4#17776 tok/s32 s$0.0008Agents & tools 62 · Coding 46 · Composite 58 · Human preference 59 · Instruction following 73 · Knowledge 43 · Long context 65 · Maths 41 · Multimodal 59 · Reasoning 59

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoningdefaultSourceTrend
LMArena Hard Prompts1427#122LMArena
GPQA Diamond (AA)not in index84.2%#14485.8%#118Artificial Analysis
Humanity's Last Exam (AA)not in index13.9%#20223.9%#139Artificial Analysis

Coding

Benchmarkno reasoningdefaultSourceTrend
WeirdML39.5%#103WeirdML
LMArena Coding1450#128LMArena
LMArena WebDev1358#88LMArena

Agents & tools

Benchmarkno reasoningdefaultSourceTrend
Terminal-Bench Hard31.8%#9932.6%#95Artificial Analysis
τ²-Bench Telecom (AA)not in index87.1%#7993.9%#39Artificial Analysis

Maths

Benchmarkno reasoningdefaultSourceTrend
AIME 202691.7%#24MathArena
HMMT February 202681.1%#26MathArena
MathArena Apex2.1%#29MathArena

Knowledge

Benchmarkno reasoningdefaultSourceTrend
AA-Omniscience-47.7#297-44.0#279Artificial Analysis

Instruction following

Benchmarkno reasoningdefaultSourceTrend
IFBench46.9%#18975.6%#29Artificial Analysis

Human preference

Benchmarkno reasoningdefaultSourceTrend
LMArena Text1408#124LMArena

Multimodal

Benchmarkno reasoningdefaultSourceTrend
LMArena Vision1242#56LMArena
MMMU-Pro70.0%#11875.0%#76Artificial Analysis

Long context

Benchmarkno reasoningdefaultSourceTrend
AA-LCR64.0%#19977.7%#87Artificial Analysis

Composite

Benchmarkno reasoningdefaultSourceTrend
AA Intelligence Index19.4#18122.9#137Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Alibaba Cloud Int.53 tok/s0.59 s$0.195$1.56262k
DeepInfra46 tok/s0.32 s$0.260$2.60262kfp8
AtlasCloud17 tok/s0.93 s$0.270$2.16262kfp8
Phala15 tok/s2.97 s$0.300$2.40262k
NovitaAI15 tok/s0.87 s$0.300$2.40262kbf16
SiliconFlow11 tok/s1.26 s$0.250$2.00262kfp8

Price history

Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.

$0.00$0.660$1.32$1.98$2.64Feb 26Mar 26Apr 26May 26Jun 26Jul 26Aug 26
input outputnow $0.195 in · $1.56 out

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.000836.0 s
Summarise a 30-page report12,000 / 600$0.005040.0 s
Code edit6,000 / 1,500$0.005451.9 s
Agentic coding session60,000 / 4,000$0.0281.4 min
Structured extraction2,000 / 200$0.001134.7 s

See also

Data as of 9 Sept 2026. Compare these configurations.