BenchLeader

GLM 5.1 vs Kimi K3

Verdict
  • Kimi K3 leads on quality: 66.5 vs 60.2.
  • GLM 5.1 is stronger in instruction following, reasoning.
  • Kimi K3 is stronger in agents & tools, coding, composite, human preference, knowledge, long context, maths, multimodal.
  • GLM 5.1 is 2.8× cheaper ($2.15 vs $6.00 per 1M blended).
  • GLM 5.1 streams 1.7× faster (65 vs 38 tokens per second).
MetricGLM 5.1Kimi K3
BenchLeader Index60.266.5
Agents & tools score56.867.4
Coding score57.365.0
Composite score62.474.2
Human preference score66.671.2
Instruction following score73.9
Knowledge score56.668.2
Long context score63.371.1
Maths score53.078.1
Reasoning score61.4
Multimodal score65.0
Blended price $/M$2.15$6.00
Output speed65 tok/s38 tok/s
Time to first answer60.1 s56.3 s
Context window200k1.0M
GPQA Diamond89.9%
FrontierMath Tiers 1–336.8%
OTIS Mock AIME93.3%
SWE-bench Verified (Epoch)74.2%
SimpleQA Verified34.0%
SimpleBench55.1%
SciCode43.8%58.7%
WeirdML57.1%
APEX-Agents39.3%
FrontierCode44.2%
ProofBench22.2%87.0%
Epoch Capabilities Index149.7157.6
LMArena Text1466
LMArena Hard Prompts1489
LMArena Coding1514
LMArena WebDev1508
LiveBench79.2%
LiveBench Reasoning90.7%
LiveBench Coding81.5%
LiveBench Agentic Coding62.2%
LiveBench Mathematics84.4%
LiveBench Data Analysis78.7%
LiveBench Language85.5%
AA Intelligence Index26.443.8
IFBench76.3%
AA-LCR73.7%88.7%
MMMU-Pro80.5%
AA-Omniscience0.819.7
Terminal-Bench Hard43.2%
GPQA Diamond (AA)86.8%93.5%
Humanity's Last Exam (AA)30.1%46.9%
SciCode (AA)44.8%59.5%
τ²-Bench Telecom (AA)97.7%
AIME (Vals)91.9%
LiveCodeBench81.4%
MMLU-Pro86.9%
LegalBench84.4%86.0%
CorpFin64.5%71.6%
TaxEval71.2%75.7%
Terminal-Bench 2.1 (Vals)56.9%80.9%
SWE-bench (Vals)76.4%93.4%
GPQA Diamond (Vals)84.5%92.9%
Vals Index57.8
AIME 202695.8%
HMMT February 202689.4%
MathArena Apex11.5%
MCP Atlas75.6%
EQ-Bench 41339

Data as of 2026-09-10. Best configuration of each model; every score links to its source on the model pages.

GLM 5.1 vs Kimi K3: questions

Is GLM 5.1 better than Kimi K3?
Kimi K3 leads on quality: 66.5 vs 60.2. The BenchLeader Index combines every independent quality benchmark; Kimi K3 is ahead overall as of 2026-09-10, but check the category scores for your use.
Is GLM 5.1 better than Kimi K3 for coding?
Kimi K3 scores higher in coding (65 vs 57 on the category index, where 50 is average).
Is GLM 5.1 better than Kimi K3 for agentic tasks?
Kimi K3 scores higher in agentic tasks (67 vs 57 on the category index, where 50 is average).
Which is cheaper, GLM 5.1 or Kimi K3?
GLM 5.1 is cheaper: $2.15 against $6.00 per million tokens, blended at three input tokens per output token.
Which is faster, GLM 5.1 or Kimi K3?
GLM 5.1 streams faster: 65 against 38 output tokens per second.
Which has the larger context window?
Kimi K3 accepts more context: 1.0M against 200k tokens.