BenchLeader

Qwen3-VL 235B-A22B

Best configuration ranks #256 of 610 on the BenchLeader Index at 52.1 ±3.9 (thinking reasoning effort). Last measured 2 Sept 2026. Released 4 Oct 2025.

Blended price
$1.30/M
$0.400 in · $4.00 out
Output speed
56 tok/s
First answer
39 s
first token 2.88 s
Context
131k
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index52
  2. Reasoning58
  3. Coding59
  4. Agents & tools43
  5. Knowledge42
  6. Instruction following57
  7. Human preference58
  8. Multimodal54
  9. Long context58
  10. Composite46

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Default” means the publisher did not say which setting was used.

EffortIndexRankSpeedFirst answerChat reply costCategories
thinkingbest52.1#25656 tok/s39 s$0.0014Agents & tools 43 · Coding 59 · Composite 46 · Human preference 58 · Instruction following 57 · Knowledge 42 · Long context 58 · Multimodal 54 · Reasoning 58
default49.6#30452 tok/s2.88 s$0.0005Agents & tools 40 · Coding 60 · Composite 42 · Human preference 60 · Instruction following 45 · Knowledge 39 · Long context 42 · Multimodal 57 · Reasoning 61

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarkthinkingdefaultSource
LMArena Hard Prompts1418#1331439#110LMArena
GPQA Diamond (AA)not in index77.2%#21571.2%#278Artificial Analysis
Humanity's Last Exam (AA)not in index11.9%#2246.6%#313Artificial Analysis

Coding

BenchmarkthinkingdefaultSource
LMArena Coding1453#1241465#108LMArena

Agents & tools

BenchmarkthinkingdefaultSource
Terminal-Bench Hard11.4%#2076.8%#240Artificial Analysis
τ²-Bench Telecom (AA)not in index54.1%#18235.1%#229Artificial Analysis

Knowledge

BenchmarkthinkingdefaultSource
AA-Omniscience-46.5#292-52.7#338Artificial Analysis

Instruction following

BenchmarkthinkingdefaultSource
IFBench56.5%#14042.6%#231Artificial Analysis

Human preference

BenchmarkthinkingdefaultSource
LMArena Text1395#1371414#114LMArena

Multimodal

BenchmarkthinkingdefaultSource
LMArena Vision1206#711247#51LMArena
MMMU-Pro68.7%#13067.6%#134Artificial Analysis
MMMU (validation)78.7%#8MMMU
MMMU-Pro (official)not in index68.1%#11MMMU

Long context

BenchmarkthinkingdefaultSource
AA-LCR63.7%#20232.7%#310Artificial Analysis

Composite

BenchmarkthinkingdefaultSource
AA Intelligence Index13.4#2439.9#314Artificial Analysis

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Alibaba Cloud Int.25 tok/s0.69 s$0.260$1.04131k
Venice19 tok/s1.56 s$0.210$1.90128kfp8
Parasail11 tok/s1.09 s$0.210$1.90131kfp8
DeepInfra4 tok/s2.56 s$0.200$0.880262kfp8
NovitaAI0 tok/s13 s$0.300$1.50131kbf16

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.110 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0014$0.001344.2 s
Summarise a 30-page report12,000 / 600$0.0072$0.004649.6 s
Code edit6,000 / 1,500$0.0084$0.00711.1 min
Agentic coding session60,000 / 4,000$0.040$0.0271.8 min
Structured extraction2,000 / 200$0.0016$0.001242.4 s

See also

Data as of 9 Sept 2026. Compare these configurations.