BenchLeader

Kimi K3 vs Nemotron 3 Ultra

Verdict
  • Kimi K3 leads on quality: 66.5 vs 58.3.
  • Kimi K3 is stronger in agents & tools, coding, composite, human preference, knowledge, long context, maths, multimodal.
  • Nemotron 3 Ultra is stronger in instruction following.
  • Nemotron 3 Ultra is 6.0× cheaper ($1.00 vs $6.00 per 1M blended).
  • Nemotron 3 Ultra streams 4.1× faster (156 vs 38 tokens per second).
MetricKimi K3Nemotron 3 Ultra
BenchLeader Index66.558.3
Agents & tools score67.452.6
Coding score65.062.3
Composite score74.243.7
Human preference score71.2
Knowledge score68.259.5
Long context score71.166.2
Maths score78.1
Multimodal score65.0
Instruction following score78.3
Blended price $/M$6.00$1.00
Output speed38 tok/s156 tok/s
Time to first answer56.3 s16.8 s
Context window1.0M1M
SciCode58.7%
APEX-Agents39.3%
FrontierCode44.2%
ProofBench87.0%
Epoch Capabilities Index157.6
LiveBench79.2%67.4%
LiveBench Reasoning90.7%74.7%
LiveBench Coding81.5%70.7%
LiveBench Agentic Coding62.2%38.7%
LiveBench Mathematics84.4%88.7%
LiveBench Data Analysis78.7%54.5%
LiveBench Language85.5%70.8%
AA Intelligence Index43.823.4
IFBench81.4%
AA-LCR88.7%79.3%
MMMU-Pro80.5%
AA-Omniscience19.7-0.4
Terminal-Bench Hard36.4%
GPQA Diamond (AA)93.5%86.7%
Humanity's Last Exam (AA)46.9%28.4%
SciCode (AA)59.5%40.3%
τ²-Bench Telecom (AA)83.3%
LiveCodeBench86.0%
MMLU-Pro85.8%
LegalBench86.0%82.1%
CorpFin71.6%65.5%
TaxEval75.7%73.1%
Terminal-Bench 2.1 (Vals)80.9%50.9%
SWE-bench (Vals)93.4%69.0%
GPQA Diamond (Vals)92.9%86.1%
Vals Index57.827.4
EQ-Bench 41339

Data as of 2026-09-10. Best configuration of each model; every score links to its source on the model pages.

Kimi K3 vs Nemotron 3 Ultra: questions

Is Kimi K3 better than Nemotron 3 Ultra?
Kimi K3 leads on quality: 66.5 vs 58.3. The BenchLeader Index combines every independent quality benchmark; Kimi K3 is ahead overall as of 2026-09-10, but check the category scores for your use.
Is Kimi K3 better than Nemotron 3 Ultra for coding?
Kimi K3 scores higher in coding (65 vs 62 on the category index, where 50 is average).
Is Kimi K3 better than Nemotron 3 Ultra for agentic tasks?
Kimi K3 scores higher in agentic tasks (67 vs 53 on the category index, where 50 is average).
Which is cheaper, Kimi K3 or Nemotron 3 Ultra?
Nemotron 3 Ultra is cheaper: $1.00 against $6.00 per million tokens, blended at three input tokens per output token.
Which is faster, Kimi K3 or Nemotron 3 Ultra?
Nemotron 3 Ultra streams faster: 156 against 38 output tokens per second.
Which has the larger context window?
Kimi K3 accepts more context: 1.0M against 1M tokens.