BenchLeader

NVIDIA

The GPU maker also publishes open Nemotron models fine-tuned from Llama and its own architectures, mostly as showcases for its inference stack.

Provider rank
#11
by best model
Best index
58.3
Nemotron 3 Ultra 550B A55B
Ranked models
19
32 open weights
Cheapest ranked
$0.063/M
Gemma 3 12B IT

Release timeline

Each model’s best configuration by release date. The top eight are labelled; hover any point for its name.

405060Feb 25Jun 25Oct 25Feb 26May 26Release dateBenchLeader IndexNemotron 3 Ultra 550B A55BGemma-4-31B-ITNemotron 3 Supernemotron-3-nano-30b-a3b (thinking)Nemotron 3 UltraByteDance-Seed/Seed-OSS-36B-InstructNemotron 3 Nano Omni 30B A3bNemotron 3 Super

Next release

Over the last two years NVIDIA shipped 24 distinct models, one every 26 days on median. The latest arrived on 11 Aug 2026.

If the cadence holds, the next one lands between 26 Aug 2026 and 16 Sept 2026.

An estimate from past release dates only. It knows nothing about roadmaps or announcements.

Fastest ranked model: nemotron-3-nano-30b-a3b at 231 tok/s.

Head to head

Models

Every NVIDIA model with a result, one row per model; switch to all configurations to see each reasoning effort.

48 of 48
#
1Nemotron 3 Ultra 550B A55BNVIDIAopen ↗58.3±7$1.0015617 s1M2026-06-042026-09-05
2Gemma-4-31B-ITNVIDIAopen ↗55.4±6$0.2053551 s256k2026-04-022026-09-08
3Nemotron 3 SuperNVIDIAopen ↗53.6±5$0.3509625 s262k2026-03-112026-09-02
4Nemotron Cascade 2 30B A3BNVIDIAopen ↗51.0±121M
5nemotron-3-nano-30b-a3bthinkingNVIDIAopen ↗48.6±10$0.0882319.82 s1M2025-12-15
6Nemotron 3 UltraNVIDIA48.2±92026-06-042026-06-04
7ByteDance-Seed/Seed-OSS-36B-InstructNVIDIA48.0±5$0.3002680 s262k2025-08-202025-08-20 · stale
8Nemotron 3 Nano Omni 30B A3bNVIDIAopen46.0±7$0.158256k2026-04-28
9Nemotron 3 SuperNVIDIA44.9±22026-03-112026-03-11 · stale
10Llama 3.3 Nemotron Super 49B v1.5NVIDIAopen44.7±6$0.400131k2025-07-252026-09-02
11Nemotron 3 Nano 4BNVIDIAopen44.1±8262k
12Llama 3.1 Nemotron 70B InstructNVIDIAopen ↗42.8±4$1.20438.27 s128k2025-04-152026-09-02
13Llama Nemotron Super 49B v1.5NVIDIAopen42.6±2$0.4003512 s128k2025-07-25
14Nemotron Nano 12B v2 VLthinkingNVIDIAopen42.0±3$0.3004258 s128k2025-10-28
15nvidia-nemotron-nano-9b-v2thinkingNVIDIA42.0±4$0.07010227 s131k2024-12-01
16Gemma 3 12B ITNVIDIAopen ↗37.2±5$0.06351.17 s131k2025-03-122026-09-02
17Gemma 3n E2b ItNVIDIAopen37.1±4128k2025-06-12
18Phi-4-MiniNVIDIAopen35.5±9$0.131450.84 s131k2025-02-272025-02-27 · stale
19Gemma 3 4B ITNVIDIAopen ↗34.5±5$0.063270.62 s131k2025-03-122026-09-02
20Llama Nemotron Super 49B v1.5thinkingNVIDIAopen$0.4005844 s128k2025-07-25
21Llama Nemotron Ultra 253BthinkingNVIDIAopen128k2025-04-07
22Gemma 2 2b ItNVIDIAopen128k2024-07-162026-09-02
23Llama 2 70B SteerlmNVIDIA2026-09-02
24Llama 3.1 Nemotron 51BNVIDIA2026-09-02
25Llama 3.3 Nemotron 49B Super v1NVIDIA2026-09-02
26Nemotron 3 Ultra 550B A55b Nvfp4NVIDIA2026-09-02
27Nemotron 3.5 LightningNVIDIAopen ↗$0.0952777.89 s1M2026-08-11
28Nemotron 3.5 Lightning 30B A3b Nvfp4NVIDIA2026-09-02
29Nemotron 4 340BNVIDIA2026-09-02
30Phi 4 MultimodalNVIDIAopen$0.140170.84 s128k2024-12-11
31solar-10.7b-instructNVIDIAopen128k2024-06-052026-09-02
32Nemotron Lightning 3.5 30B A3bNVIDIA2026-09-05
33Nvila Internal 15B v1NVIDIA2026-08-27
34BGE M3NVIDIAopen8k2024-01-30
35Cosmos Reason2 8BNVIDIAopen ↗131k2025-12-01
36dracarys-llama-3.1-70b-instructNVIDIAopen128k2024-09-11
37gliner-piiNVIDIAopen ↗128k2026-03-03
38Laguna XS 2.1NVIDIAopen ↗$0.0751180.18 s262k2026-07-02
39Llama 3.1 Nemotron Nano 8B v1NVIDIAopen ↗131k2025-03-18
40Llama 3.1 Nemotron Nano VL 8B v1NVIDIAopen ↗33k2025-04-10
41Nemotron 3.5 Lightning 30B A3BNVIDIAopen262k2026-08-11
42Nemotron-4 15BNVIDIA2024-02-26
43nemotron-mini-4b-instructNVIDIAopen ↗128k2024-08-21
44nemotron-voicechatNVIDIAopen128k2026-03-16
45riva-translate-4b-instruct-v1_1NVIDIAopen128k2025-12-12
46StarCoder 2 15BNVIDIA
47StarCoder 2 3BNVIDIA
48StarCoder 2 7BNVIDIA

Latest news