BenchLeader

Llama 3.3 Nemotron Super 49B v1.5

Reasoning effort

Llama 3.3 Nemotron Super 49B v1.5 is a NVIDIA open-weights model, released 18 Mar 2025. Its best configuration (thinking reasoning effort) ranks #629 of 785 on the BenchLeader Index at 41.5 ±2.7, in the lower half. The ± is the point: 278 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in instruction following (41) and lowest in long context (33). At $0.400 per million tokens blended it is cheaper than most ranked models. It has been measured at 3 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 18 Mar 2025.stale: no new result in six months

Blended price
$0.400/M
$0.400 in · $0.400 out
Output speed
–
First answer
–
Context
131k
Full answer
–
Cost per run
–
Released
18 Mar 2025
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index42
  2. Reasoning41
  3. Agents & tools34
  4. Knowledge35
  5. Instruction following41
  6. Long context33
  7. Composite39

Versions

NVIDIA has shipped 2 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.

ModelReleasedIndexRank
Llama Nemotron Super 49B v1.5thinking25 Jul 202543.6#565
Llama 3.3 Nemotron Super 49B v1.5thinkingthis page18 Mar 202541.5#629

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning41.4#632––$0.0003Agents & tools 34 · Composite 38 · Instruction following 42 · Knowledge 39 · Long context 30 · Reasoning 41
thinkingbest41.5#629––$0.0003Agents & tools 34 · Composite 39 · Instruction following 41 · Knowledge 35 · Long context 33 · Reasoning 41
not stated––––$0.0003Coding 53 · Human preference 51 · Maths 56 · Reasoning 51

How its index has moved

9 Sept 2026 to 21 Oct 2026
394245
  • thinking
  • no reasoning

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoningthinkingnot statedSourceTrend
Arena Hard Promptseffort not stated––1364#203Arena (LMArena)
GPQA Diamond (AA)not in index51.7%#41764.3%#348–Artificial Analysis
Humanity's Last Exam (AA)not in index3.8%#5635.6%#420–Artificial Analysis
CritPt0.0%#3150.0%#315–Artificial Analysis

Coding

Benchmarknot statedSourceTrend
Arena Coding1403#191Arena (LMArena)

Agents & tools

Benchmarkno reasoningthinkingSourceTrend
Terminal-Bench Hard0.0%#3620.0%#362Artificial Analysis
τ²-Bench Telecom (AA)not in index–26.9%#279Artificial Analysis

Maths

Benchmarknot statedSourceTrend
Arena Maths1387#166Arena (LMArena)

Knowledge

Benchmarkno reasoningthinkingSourceTrend
AA-Omniscience-50.3#387-58.3#452Artificial Analysis
AA-Omniscience: accuracynot in index13.5%#45517.1%#373Artificial Analysis
AA-Omniscience: non-hallucinationnot in index26.3%#2359.1%#440Artificial Analysis

Instruction following

Benchmarkno reasoningthinkingnot statedSourceTrend
IFBench39.5%#26838.1%#282–Artificial Analysis
Arena Instruction Followingnot in indexeffort not stated––1325#212Arena (LMArena)

Human preference

Benchmarknot statedSourceTrend
Arena Text1343#209Arena (LMArena)
Arena Creative Writingnot in index1305#211Arena (LMArena)
Arena Multi-turnnot in index1340#205Arena (LMArena)
Arena Longer Queriesnot in index1343#210Arena (LMArena)

Long context

Benchmarkno reasoningthinkingSourceTrend
AA-LCR12.0%#46218.3%#443Artificial Analysis

Composite

Benchmarkno reasoningthinkingSourceTrend
AA Intelligence Index v4.3.27.3#4858.9#421Artificial Analysis

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0003––
Summarize a 30-page report12,000 / 600$0.0050––
Code edit6,000 / 1,500$0.0030––
Agentic coding session60,000 / 4,000$0.026––
Structured extraction2,000 / 200$0.0009––

More from NVIDIA

New this month

See also

Questions people ask

What are Llama 3.3 Nemotron Super 49B v1.5's benchmark scores?
As of 25 Oct 2026, Llama 3.3 Nemotron Super 49B v1.5 (thinking effort) scores 41.5 ±2.7 on the BenchLeader Index, strongest in instruction following (41) and weakest in long context (33). That rests on 6 independent benchmark results, and every score on this page links to its publisher.
How does Llama 3.3 Nemotron Super 49B v1.5 rank?
Llama 3.3 Nemotron Super 49B v1.5 (thinking effort) is #629 of 785 ranked configurations on 25 Oct 2026. 278 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Opus 5.5 (max effort) at 72.6.
How much does Llama 3.3 Nemotron Super 49B v1.5 cost per 1M tokens?
As of 25 Oct 2026, Llama 3.3 Nemotron Super 49B v1.5 costs $0.400 per 1M input tokens and $0.400 per 1M output tokens, $0.400 blended (three input tokens per output token).
When was Llama 3.3 Nemotron Super 49B v1.5 released?
NVIDIA released Llama 3.3 Nemotron Super 49B v1.5 on 18 Mar 2025. BenchLeader has results for it at 3 reasoning-effort settings.

Data as of 25 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “Llama 3.3 Nemotron Super 49B v1.5: benchmarks, pricing, speed and rank”, data as of 25 Oct 2026, https://www.benchleader.com/models/llama-3-3-nemotron-super-49b.