BenchLeader

Olmoe 1B 7B January 2025

Olmoe 1B 7B January 2025 is an Ai2 proprietary model. It is not yet ranked: 3 independent results so far, and the index needs at least five across two categories. Last measured 24 Nov 2025.stale: no new result in six months

Blended price
Output speed
First answer
Context
Released
date not published by our sources
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Maths25
  2. Instruction following11

Benchmark results

One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

BenchmarkdefaultSource
GPQA Diamond (HELM)not in index22.0%#67HELM Capabilities

Maths

BenchmarkdefaultSource
Omni-MATH (HELM)9.3%#67HELM Capabilities

Knowledge

BenchmarkdefaultSource
MMLU-Pro (HELM)not in index16.9%#68HELM Capabilities

Instruction following

Composite

BenchmarkdefaultSource
HELM Capabilities meannot in index33.2%#67HELM Capabilities

See also

Data as of 12 Sept 2026. Compare with another model.

Cite as: BenchLeader, “Olmoe 1B 7B January 2025: benchmarks, pricing, speed and rank”, https://www.benchleader.com/models/olmoe-1b-7b-january-2025, data as of 12 Sept 2026.