BenchLeader

Allenai

Provider rank
#35
by best model
Best index
44.6
Olmo 3.1 32B (thinking)
Ranked models
3
0 open weights
Cheapest ranked

Release timeline

Each model’s best configuration by release date. The top eight are labelled; hover any point for its name.

Not enough dated, ranked models to draw a timeline.

Next release

Not enough dated releases to estimate a cadence.

Head to head

Models

Every Allenai model with a result, one row per model; switch to all configurations to see each reasoning effort.

9 of 9
#
1Olmo 3.1 32BthinkingAllenai44.6±866k2026-09-02
2Olmo 3 32BthinkingAllenai43.4±666k2026-09-02
3Molmo 7B DAllenai34.5±74k2026-08-27
4Llama 3.1 Tulu 3 70BAllenai2026-09-02
5Llama 3.1 Tulu 3 8BAllenai2026-09-02
6Molmo 2 8BAllenai2026-09-02
7Olmo 2 0325 32BAllenai2026-09-02
8Olmo 7BAllenai2026-09-02
9Molmo 72BAllenai2026-08-27

Latest news