Qwen3-4B-Instruct-2507
As of 16 Nov 2026, Qwen3-4B-Instruct-2507 by Alibaba scores 42.0 on the BenchLeader Index (608 ranked configurations), with its best results in maths (46) and weakest in long context (29). Released 6 Aug 2025.
Key facts (as of 16 Nov 2026)
- Qwen3-4B-Instruct-2507 was released on 6 Aug 2025 (Alibaba).
In detail. Qwen3-4B-Instruct-2507 is an Alibaba open-weights model, released 6 Aug 2025. Its best configuration ranks #504 of 608 on the BenchLeader Index at 42.0 ±5.1, in the lower half. The ± is the point: 196 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in maths (46) and lowest in long context (29). It has been measured at 2 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 6 Aug 2025.stale: no new result in six months
- Blended price
- –
- Output speed
- –
- First answer
- –
- Context
- 262k
- via Artificial Analysis
- Cost per task
- –
- Tokens per task
- –
- Released
- 6 Aug 2025
- Overall index42
- Reasoning35
- Agents & tools44
- Maths46
- Instruction following37
- Long context29
Embed this rank
More badge styles[](https://www.benchleader.com/models/qwen3-4b-2507)Paste it at the top of README.md, beside your other badges. The badge redraws with every data update and links back to this page.
Reasoning-effort configurations
The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.
| Effort | Index | Rank | Speed | First answer | Chat reply cost | Categories |
|---|---|---|---|---|---|---|
| thinking | 40.2 | #533 | – | – | – | Agents & tools 35 · Instruction following 51 · Long context 42 · Maths 13 |
| not statedbest | 42.0 | #504 | – | – | – | Agents & tools 44 · Instruction following 37 · Long context 29 · Maths 46 · Reasoning 35 |
How its index has moved
10 Sep 2026 to 16 Nov 2026- not stated
- thinking
The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.
Benchmark results
See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.
Metadata
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| AA Openness Indexnot in index | 44.4#97 | 44.4#97 | Artificial Analysis |
Reasoning
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| GPQA Diamondeffort not stated | – | 45.8%#249 | Epoch AI Benchmarking Hub |
| GPQA Diamond (AA)not in index | 66.7%#335 | 51.7%#424 | Artificial Analysis |
| Humanity's Last Exam (AA)not in index | 6.2%#427 | 4.5%#521 | Artificial Analysis |
| CritPtnot in index | 0.0%#337 | 0.0%#337 | Artificial Analysis |
Coding
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| LiveCodeBench (AA)not in index | 64.1%#95 | 37.7%#176 | Artificial Analysis |
Agents & tools
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| Terminal-Bench Hard | 1.5%#343 | 4.5%#289 | Artificial Analysis |
| τ²-Bench Telecom (AA)not in index | 25.4%#296 | 26.6%#285 | Artificial Analysis |
| BFCL Overalleffort not stated | – | 35.7%#41 | Berkeley Function Calling Leaderboard |
Maths
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| OTIS Mock AIMEeffort not stated | – | 52.2%#193 | Epoch AI Benchmarking Hub |
| AIME 2026 | 82.5%#30 | – | MathArena |
| HMMT February 2026 | 53.0%#31 | – | MathArena |
| MathArena Apex | 2.1%#29 | – | MathArena |
| AIME 2025 (AA)not in index | 82.7%#54 | 52.3%#132 | Artificial Analysis |
Knowledge
| Benchmark | not stated | Source |
|---|---|---|
| Global-MMLU-Lite (AA)not in index | 67.7%#104 | Artificial Analysis |
Instruction following
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| IFBench | 49.8%#177 | 33.5%#331 | Artificial Analysis |
Long context
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| AA-LCR v1.1 | 37.3%#392 | 11.3%#487 | Artificial Analysis |
Composite
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| AA Intelligence Index v4.3.2not in index | 8.8#434 | 6.7#518 | Artificial Analysis |
| AA Progress Index v1not in index | 206.4#398 | 173.9#494 | Artificial Analysis |
More from Alibaba
See also
Embed or cite
Show where Qwen3-4B-Instruct-2507 ranks on a model card or README. The badge redraws itself with every daily update, carries the data date and links back to this page.
[](https://www.benchleader.com/models/qwen3-4b-2507)Cite this
The ranking changes daily, so a reference carries the data date. APA style:
BenchLeader. (2026, November 16). Qwen3-4B-Instruct-2507 on the BenchLeader Index (method v1.4) [Data set]. Retrieved November 16, 2026, from https://www.benchleader.com/models/qwen3-4b-2507
BibTeX:
@misc{benchleader_qwen3_4b_2507_20261116,
author = {{BenchLeader}},
title = {{Qwen3-4B-Instruct-2507 on the BenchLeader Index (method v1.4)}},
year = {2026},
month = nov,
howpublished = {\url{https://www.benchleader.com/models/qwen3-4b-2507}},
note = {Data as of 2026-11-16}
}Every badge style, the embeddable top-10 widget and how to cite the Index
Questions people ask
- What are Qwen3-4B-Instruct-2507's benchmark scores?
- As of 16 Nov 2026, Qwen3-4B-Instruct-2507 scores 42.0 ±5.1 on the BenchLeader Index, strongest in maths (46) and weakest in long context (29). That rests on independent benchmark results only, and every score on this page links to its publisher.
- How does Qwen3-4B-Instruct-2507 rank?
- Qwen3-4B-Instruct-2507 is #504 of 608 ranked configurations on 16 Nov 2026. 196 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Fable 5.2 (max effort) at 72.7.
- When was Qwen3-4B-Instruct-2507 released?
- Alibaba released Qwen3-4B-Instruct-2507 on 6 Aug 2025. BenchLeader has results for it at 2 reasoning-effort settings.
Data as of 16 Nov 2026. Compare these configurations.
Cite as: BenchLeader, “Qwen3-4B-Instruct-2507: benchmarks, pricing, speed and rank”, data as of 16 Nov 2026, https://www.benchleader.com/models/qwen3-4b-2507.