Ai2Olmo 3 7B Think
Olmo 3 7B Think is an Ai2 open-weights model, released 20 Nov 2025. Its best configuration (thinking reasoning effort) ranks #678 of 785 on the BenchLeader Index at 39.7 ±5.5, in the lower half. The ± is the point: 279 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in instruction following (44) and lowest in long context (23). It has been measured at 2 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 20 Nov 2025.stale: no new result in six months
- Blended price
- –
- Output speed
- –
- First answer
- –
- Context
- 66k
- Full answer
- –
- Cost per run
- –
- Released
- 20 Nov 2025
- Overall index40
- Reasoning41
- Agents & tools34
- Knowledge29
- Instruction following44
- Long context23
- Composite36
Reasoning-effort configurations
The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.
| Effort | Index | Rank | Speed | First answer | Chat reply cost | Categories |
|---|---|---|---|---|---|---|
| thinkingbest | 39.7 | #678 | – | – | – | Agents & tools 34 · Composite 36 · Instruction following 44 · Knowledge 29 · Long context 23 · Reasoning 41 |
| not stated | 38.5 | #713 | – | – | – | Agents & tools 34 · Composite 35 · Instruction following 36 · Knowledge 27 · Long context 23 · Reasoning 41 |
How its index has moved
9 Sept 2026 to 21 Oct 2026- thinking
- not stated
The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.
Benchmark results
See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.
Metadata
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| AA Openness Indexnot in index | 88.9#1 | 88.9#1 | Artificial Analysis |
Reasoning
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| GPQA Diamond (AA)not in index | 51.6%#419 | 40.0%#479 | Artificial Analysis |
| Humanity's Last Exam (AA)not in index | 6.0%#409 | 5.8%#416 | Artificial Analysis |
| CritPt | 0.0%#315 | 0.0%#315 | Artificial Analysis |
Agents & tools
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| Terminal-Bench Hard | 0.8%#349 | 0.0%#362 | Artificial Analysis |
| τ²-Bench Telecom (AA)not in index | 0.0%#393 | 12.6%#373 | Artificial Analysis |
Knowledge
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| AA-Omniscience | -71.8#520 | -77.1#531 | Artificial Analysis |
| AA-Omniscience: accuracynot in index | 11.1%#485 | 7.4%#523 | Artificial Analysis |
| AA-Omniscience: non-hallucinationnot in index | 6.8%#497 | 8.8%#448 | Artificial Analysis |
Instruction following
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| IFBench | 41.5%#246 | 32.8%#336 | Artificial Analysis |
Long context
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| AA-LCR | 0.0%#493 | 0.0%#493 | Artificial Analysis |
Composite
| Benchmark | thinking | not stated | Source |
|---|---|---|---|
| AA Intelligence Index v4.3.2 | 5.6#569 | 5.2#592 | Artificial Analysis |
See also
Questions people ask
- What are Olmo 3 7B Think's benchmark scores?
- As of 25 Oct 2026, Olmo 3 7B Think (thinking effort) scores 39.7 ±5.5 on the BenchLeader Index, strongest in instruction following (44) and weakest in long context (23). That rests on 6 independent benchmark results, and every score on this page links to its publisher.
- How does Olmo 3 7B Think rank?
- Olmo 3 7B Think (thinking effort) is #678 of 785 ranked configurations on 25 Oct 2026. 279 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Opus 5.5 (max effort) at 72.6.
- When was Olmo 3 7B Think released?
- Ai2 released Olmo 3 7B Think on 20 Nov 2025. BenchLeader has results for it at 2 reasoning-effort settings.
Data as of 25 Oct 2026. Compare these configurations.
Cite as: BenchLeader, “Olmo 3 7B Think: benchmarks, pricing, speed and rank”, data as of 25 Oct 2026, https://www.benchleader.com/models/olmo-3-7b.