BenchLeader

Agnes 2.5 Pro Theta vs Nemotron 3 Super 120B A12B

Full profiles: Agnes 2.5 Pro Theta (Sapiens AI) and Nemotron 3 Super 120B A12B (NVIDIA): every benchmark, price and rank.

Updated · Data from 3 sources

As of 16 Nov 2026, Agnes 2.5 Pro Theta and Nemotron 3 Super 120B A12B are neck and neck on quality (50.8 vs 51.1 on the BenchLeader Index, inside the ±14.4 margin), and Agnes 2.5 Pro Theta is 3.0× cheaper at $0.150 vs $0.450 per 1M tokens blended. Agnes 2.5 Pro Theta leads in every category we measure both in. Agnes 2.5 Pro Theta streams faster.

Key facts (as of 16 Nov 2026)

  • Agnes 2.5 Pro Theta scores 50.8 on the BenchLeader Index and Nemotron 3 Super 120B A12B scores 51.1 (BenchLeader, 16 Nov 2026).
  • Agnes 2.5 Pro Theta costs $0.150 per 1M tokens blended (list price, 16 Nov 2026).
  • Nemotron 3 Super 120B A12B costs $0.450 per 1M tokens blended (list price, 16 Nov 2026).
  • Agnes 2.5 Pro Theta streams faster than Nemotron 3 Super 120B A12B (Artificial Analysis, 7-day median, 16 Nov 2026).
  • Of the 9 benchmarks both models have, Agnes 2.5 Pro Theta leads 9 (BenchLeader, 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
ReasoningAgnes 2.5 Pro Theta44 vs 35 category score; HLE-Diamond (AA) 16.8% vs 4.9%High
Long documentsAgnes 2.5 Pro Theta67 vs 57 category score; AA-LCR v1.1 84.7% vs 65.7%High
Lowest costAgnes 2.5 Pro Theta$0.150 vs $0.450 per 1M blended; agentic coding session $0.007 vs $0.022–
Fastest first answerAgnes 2.5 Pro Theta8.1 s (Agnes 2.5 Pro Theta) vs 10.7 s (Nemotron 3 Super 120B A12B (thinking)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Agnes 2.5 Pro Theta and Nemotron 3 Super 120B A12B (thinking) are neck and neck on quality (50.8 vs 51.1, within the ±14.4 margin).
  • Agnes 2.5 Pro Theta is stronger in long context, reasoning.
  • Agnes 2.5 Pro Theta is 3.0× cheaper ($0.150 vs $0.450 per 1M blended).

At a glance

SpecAgnes 2.5 Pro ThetaNemotron 3 Super 120B A12B
DeveloperSapiens AINVIDIA
Released7 Nov 202611 Mar 2026
Context window (tokens)1,000,000262,144
Compared atAgnes 2.5 Pro ThetaNemotron 3 Super 120B A12B (thinking)
Open weightsNoYes
Price in / out / cached input per 1M$0.100 / $0.300 / –$0.300 / $0.900 / $0.060

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryAgnes 2.5 Pro ThetaNemotron 3 Super 120B A12B (thinking)Leader
Reasoning43.734.7Agnes 2.5 Pro Theta
Coding45.7–not comparable
Agents & tools–44.9not comparable
Knowledge38.7–not comparable
Instruction following–70.2not comparable
Multimodal60.8–not comparable
Long context67.157.2Agnes 2.5 Pro Theta

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingAgents & toolsKnowledgeInstructionfollowingLong contextMultimodalAgnes 2.5 Pro Theta, Reasoning: 43.7Agnes 2.5 Pro Theta, Coding: 45.7Agnes 2.5 Pro Theta, Knowledge: 38.7Agnes 2.5 Pro Theta, Long context: 67.1Agnes 2.5 Pro Theta, Multimodal: 60.8Nemotron 3 Super 120B A12B, Reasoning: 34.7Nemotron 3 Super 120B A12B, Agents & tools: 44.9Nemotron 3 Super 120B A12B, Instruction following: 70.2Nemotron 3 Super 120B A12B, Long context: 57.2

Dashed: that model has no result on the axis it crosses; the line only joins its neighbours.

Not drawn, no result for these models: Maths, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 9 benchmarks both have, Agnes 2.5 Pro Theta leads 9, Nemotron 3 Super 120B A12B leads 0.

Overall indexAgnes 2.5 Pro ThetaNemotron 3 Super 120B A12B (thinking)Leader
BenchLeader Index50.851.1neck and neck

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureAgnes 2.5 Pro ThetaNemotron 3 Super 120B A12B (thinking)
Blended price per 1M tokens$0.150$0.450
Input / output per 1M$0.100 / $0.300$0.300 / $0.900
Cached input per 1M–$0.060
Price per task: chat reply$0.0001$0.0004
Price per task: summarize a 30-page report$0.0014$0.0041
Price per task: code edit$0.0011$0.0032
Price per task: agentic coding session$0.0072$0.022
Price per task: structured extraction$0.0003$0.0008
Agentic coding session, input mostly cached–$0.011
Cost per benchmark task (AA Index)$0.575–
Output tokens per task (AA Index)278k–
Of which reasoning229k–
Time per task (AA Index)24 min–
Output speed190 tok/s183 tok/s
Time to first answer8.1 s10.7 s
Time to a complete answer, last measured 13 Nov 202616.9 s38.6 s

Each model is compared at its best-ranked reasoning-effort setting. Agnes 2.5 Pro Theta scores 50.8 and takes 8 s to its first answer token. Nemotron 3 Super 120B A12B (thinking) scores 51.1 and takes 11 s to its first answer token. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

39 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherAgnes 2.5 Pro ThetaNemotron 3 Super 120B A12B (thinking)
BenchLeader IndexBenchLeader50.851.1
Coding scoreBenchLeader45.7–
Knowledge scoreBenchLeader38.7–
Long context scoreBenchLeader67.157.2
Multimodal scoreBenchLeader60.8–
Reasoning scoreBenchLeader43.734.7
Agents & tools scoreBenchLeader–44.9
Instruction following scoreBenchLeader–70.2
Blended price $/MBenchLeader$0.150$0.450
Output speedBenchLeader190 tok/s183 tok/s
Time to first answerBenchLeader8.1 s10.7 s
Context windowBenchLeader1,000,000 tokens262,144 tokens
Reasoning
Arena Hard PromptsArena (LMArena)–1378†
GPQA Diamond (AA)Artificial Analysis–80.0%
Humanity's Last Exam (AA)Artificial Analysis37.2%20.8%
HLE-Diamond (AA)Artificial Analysis16.8%4.9%
CritPtArtificial Analysis15.1%3.1%
CritPt v2 hard subset (AA)Artificial Analysis26.0%–
Arena ExpertArena (LMArena)–1394†
Coding
Arena CodingArena (LMArena)–1407†
SciCode (AA)Artificial Analysis56.0%36.2%
Terminal-Bench 4.0 (AA)Artificial Analysis10.1%0.0%
Terminal-Bench 2.1 (AA)Artificial Analysis–38.6%
FrontierCode 2.0 (AA)Artificial Analysis16.6%–
Agents & tools
Terminal-Bench HardArtificial Analysis–28.8%
τ²-Bench Telecom (AA)Artificial Analysis–67.8%
GDPval-AA v2.1Artificial Analysis1507497
τ³-Banking (AA)Artificial Analysis–10.3%
ITBench SRE (AA)Artificial Analysis–1.1%
APEX-Agents (AA)Artificial Analysis–1.8%
AutomationBenchArtificial Analysis48.8%3.8%
GDP.pdf (AA)Artificial Analysis14.2%2.6%
EnterpriseOps-GymArtificial Analysis–23.6%
AA-Briefcase v1.1Artificial Analysis1496–
Terminal-Bench-Science 0.1 (AA)Artificial Analysis3.8%–
Maths
Arena MathsArena (LMArena)–1370†
Knowledge
AA-Omniscience v1.1Artificial Analysis-11.2–
Show all 39 benchmarks
MetricPublisherAgnes 2.5 Pro ThetaNemotron 3 Super 120B A12B (thinking)
Knowledge
AA-Omniscience v1.1: accuracyArtificial Analysis21.3%–
AA-Omniscience v1.1: non-hallucinationArtificial Analysis58.6%–
Instruction following
IFBenchArtificial Analysis–71.5%
Arena Instruction FollowingArena (LMArena)–1342†
Human preference
Arena TextArena (LMArena)–1360†
Arena Creative WritingArena (LMArena)–1302†
Arena Multi-turnArena (LMArena)–1349†
Arena Longer QueriesArena (LMArena)–1357†
Multimodal
MMMU-ProArtificial Analysis78.4%–
Long context
AA-LCR v1.1Artificial Analysis84.7%65.7%
Composite
AA Intelligence Index v5.0.1Artificial Analysis24.0–
AA Intelligence Index v4.3.2Artificial Analysis–12.8
AA Progress Index v1Artificial Analysis–233.7
Metadata
AA Openness IndexArtificial Analysis–83.3

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Nemotron 3 Super 120B A12B (thinking): 1 new result (GDPval-AA v2.1).
  • Agnes 2.5 Pro Theta: first results.
  • Nemotron 3 Super 120B A12B (thinking): BenchLeader Index 52.4 → 51.1.
  • Nemotron 3 Super 120B A12B (thinking): 2 new results (AA Progress Index v1, HLE-Diamond (AA)).
  • Nemotron 3 Super 120B A12B (thinking): cached input price moved from $0.30/M to $0.060/M (80% down).
  • Nemotron 3 Super 120B A12B (thinking): BenchLeader Index 52.9 → 52.4.
  • Nemotron 3 Super 120B A12B (thinking): 4 new results (AutomationBench, GDP.pdf (AA), MLCR…).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Agnes 2.5 Pro Theta vs Nemotron 3 Super 120B A12B: questions

Is Agnes 2.5 Pro Theta better than Nemotron 3 Super 120B A12B?
Agnes 2.5 Pro Theta and Nemotron 3 Super 120B A12B (thinking) are neck and neck on quality (50.8 vs 51.1, within the ±14.4 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 16 Nov 2026, so check the category scores for your use.
Agnes 2.5 Pro Theta vs Nemotron 3 Super 120B A12B: which is cheaper, and will that change?
Agnes 2.5 Pro Theta is cheaper today: $0.150 against $0.450 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Which is faster, Agnes 2.5 Pro Theta or Nemotron 3 Super 120B A12B?
Agnes 2.5 Pro Theta streams faster (190 vs 183 output tokens per second, Artificial Analysis 7-day median).
Which is better for long documents?
Agnes 2.5 Pro Theta scores higher on long-context benchmarks (67 vs 57). Agnes 2.5 Pro Theta accepts more context: 1,000,000 against 262,144 tokens for Nemotron 3 Super 120B A12B.
Which has lower latency?
Agnes 2.5 Pro Theta answers first: 8.1 s against 10.7 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
More questions (2)
Do independent benchmarks agree on Agnes 2.5 Pro Theta vs Nemotron 3 Super 120B A12B?
Across the 9 benchmarks both have, Agnes 2.5 Pro Theta leads 9, Nemotron 3 Super 120B A12B leads 0.
When was Agnes 2.5 Pro Theta released?
Agnes 2.5 Pro Theta was released on 7 Nov 2026.