BenchLeader

Grok 4.20 Multi-Agent vs Kimi K3

Verdict
  • Kimi K3 (max) leads on quality: 67.1 vs 59.2.
  • Kimi K3 (max) is stronger in coding, human preference, maths, multimodal, reasoning, agents & tools, composite, knowledge, long context.
  • Grok 4.20 Multi-Agent is 3.8× cheaper ($1.56 vs $6.00 per 1M blended).
  • Grok 4.20 Multi-Agent streams 7.1× faster (304 vs 43 tokens per second).
MetricGrok 4.20 Multi-AgentKimi K3 (max)
BenchLeader Index59.267.1
Coding score65.567.0
Human preference score67.068.8
Maths score64.465.3
Multimodal score60.465.1
Reasoning score65.968.6
Agents & tools score67.5
Composite score84.0
Knowledge score64.4
Long context score70.9
Blended price $/M$1.56$6.00
Output speed304 tok/s43 tok/s
Time to first answer9.9 s50.5 s
Context window1M1.0M
GPQA Diamond93.1%
FrontierMath Tiers 1–372.2%
FrontierMath Tier 439.0%
OTIS Mock AIME97.2%
SimpleQA Verified50.6%
SimpleBench60.7%
SciCode58.7%
WeirdML82.6%
LMArena Text14701485
LMArena Hard Prompts14831514
LMArena Coding15081538
LMArena WebDev1674
LMArena Vision1260
LMArena Agent6.2
AA Intelligence Index43.6
AA-LCR88.7%
MMMU-Pro80.5%
AA-Omniscience19.7
GPQA Diamond (AA)93.5%
Humanity's Last Exam (AA)46.9%
SciCode (AA)59.5%
LiveCodeBench87.2%
MMLU-Pro88.0%
IOI48.9%
MCP Atlas82.3%
ARC-AGI-194.5%
ARC-AGI-260.4%
CritPt23.4%
GDPval (AA)51.2%
τ²-Bench Banking (AA)46.0%
ITBench SRE (AA)47.7%
Analyst Agent (AA)38.8%
APEX-Agents (AA)41.3%
BioMysteryBench71.5%
Code Migration16.1%
Excel Modeling Benchmark66.4%
Tax Agent Bench68.7%
Terminal-Bench 4.0 (Vals)12.6%
Terminal-Bench Science2.9%
Time Horizon Index: KSP10.5%
Vibe Code Bench 1-10018.2%
FORTRESS26.6%
LMArena Maths14531501
LMArena Creative Writing14481458
LMArena Instruction Following14431484
LMArena Multi-turn14731496
LMArena Longer Queries14571500
LMArena Search1205
Chess Puzzles39.0%
Mystery Game Puzzles26.0%
Surface Evolver Bench93.0%
DeepSWE68.5%
LMCA52.7%
DTBench91.2%
CursorBench60.8%
ALE-Bench1524.5
GDP.pdf19.0%
FrontierSWE25.9%

Data as of 2026-09-21. Best configuration of each model; every score links to its source on the model pages.

Grok 4.20 Multi-Agent vs Kimi K3: questions

Is Grok 4.20 Multi-Agent better than Kimi K3?
Kimi K3 (max) leads on quality: 67.1 vs 59.2. The BenchLeader Index combines every independent quality benchmark; Kimi K3 (max) is ahead overall as of 2026-09-21, but check the category scores for your use.
Is Grok 4.20 Multi-Agent better than Kimi K3 for coding?
Kimi K3 scores higher in coding (67 vs 66 on the category index, where 50 is average).
Which is cheaper, Grok 4.20 Multi-Agent or Kimi K3?
Grok 4.20 Multi-Agent is cheaper: $1.56 against $6.00 per million tokens, blended at three input tokens per output token.
Which is faster, Grok 4.20 Multi-Agent or Kimi K3?
Grok 4.20 Multi-Agent streams faster: 304 against 43 output tokens per second.
Which has the larger context window?
Kimi K3 accepts more context: 1.0M against 1M tokens.