BenchLeader

GLM-5 vs Kimi K3.1 Pro

Full profiles: GLM-5 (Zhipu AI) and Kimi K3.1 Pro (Moonshot AI): every benchmark, price and rank.

Updated · Data from 11 sources

As of 16 Nov 2026, GLM-5 and Kimi K3.1 Pro are neck and neck on quality (60.2 vs 61.8 on the BenchLeader Index, inside the ±4.7 margin), and GLM-5 is 2.6× cheaper at $1.55 vs $4.00 per 1M tokens blended. Choose GLM-5 for reasoning (68 vs 59) and fast first answers (29.2 s vs 157.4 s), where it also streams ~2× faster; choose Kimi K3.1 Pro for maths (73 vs 63), agents & tools (65 vs 58), and long context (68 vs 62).

Key facts (as of 16 Nov 2026)

  • GLM-5 scores 60.2 on the BenchLeader Index and Kimi K3.1 Pro scores 61.8 (BenchLeader, 16 Nov 2026).
  • GLM-5 costs $1.55 per 1M tokens blended (list price, 16 Nov 2026).
  • Kimi K3.1 Pro costs $4.00 per 1M tokens blended (list price, 16 Nov 2026).
  • GLM-5 streams ~2× faster than Kimi K3.1 Pro (Artificial Analysis, 7-day median, 16 Nov 2026).
  • Of the 5 benchmarks both models have, Kimi K3.1 Pro leads 4 (BenchLeader, 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingEither59 vs 60 category scoreEither
Agents & tool useKimi K3.1 Pro65 vs 58 category scoreMedium
MathsKimi K3.1 Pro73 vs 63 category scoreHigh
ReasoningGLM-568 vs 59 category score; Humanity's Last Exam (AA) 29.3% vs 52.5%High
KnowledgeEither57 vs 58 category scoreEither
Long documentsKimi K3.1 Pro68 vs 62 category score; AA-LCR v1.1 86.3% vs 75.7%Medium
Lowest costGLM-5$1.55 vs $4.00 per 1M blended; agentic coding session $0.073 vs $0.160–
Fastest first answerGLM-529.2 s (GLM-5 (thinking)) vs 157.4 s (Kimi K3.1 Pro) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GLM-5 (thinking) and Kimi K3.1 Pro are neck and neck on quality (60.2 vs 61.8, within the ±4.7 margin).
  • GLM-5 (thinking) is stronger in reasoning.
  • Kimi K3.1 Pro is stronger in agents & tools, coding, knowledge, long context, maths.
  • GLM-5 (thinking) is 2.6× cheaper ($1.55 vs $4.00 per 1M blended).
  • GLM-5 (thinking) streams 2.3× faster (69 vs 30 tokens per second).

At a glance

SpecGLM-5Kimi K3.1 Pro
DeveloperZhipu AIMoonshot AI
Released11 Feb 202623 Oct 2026
Context window (tokens)204,8001,048,576
Compared atGLM-5 (thinking)Kimi K3.1 Pro
Open weightsYesYes
Price in / out / cached input per 1M$1.00 / $3.20 / $0.200$2.00 / $10.00 / $0.200

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGLM-5 (thinking)Kimi K3.1 ProLeader
Reasoning68.259.2GLM-5
Coding59.159.6level
Agents & tools58.064.6Kimi K3.1 Pro
Maths63.473.4Kimi K3.1 Pro
Knowledge57.458.2level
Instruction following70.9–not comparable
Multimodal–66.3not comparable
Long context62.467.9Kimi K3.1 Pro

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingAgents & toolsMathsKnowledgeLong contextGLM-5, Reasoning: 68.2GLM-5, Coding: 59.1GLM-5, Agents & tools: 58.0GLM-5, Maths: 63.4GLM-5, Knowledge: 57.4GLM-5, Long context: 62.4Kimi K3.1 Pro, Reasoning: 59.2Kimi K3.1 Pro, Coding: 59.6Kimi K3.1 Pro, Agents & tools: 64.6Kimi K3.1 Pro, Maths: 73.4Kimi K3.1 Pro, Knowledge: 58.2Kimi K3.1 Pro, Long context: 67.9

Not drawn, measured for fewer than two of these models: Instruction following, Multimodal, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 5 benchmarks both have, GLM-5 leads 1, Kimi K3.1 Pro leads 4. Every overall index that rates both puts Kimi K3.1 Pro ahead.

Overall indexGLM-5 (thinking)Kimi K3.1 ProLeader
BenchLeader Index60.261.8neck and neck
Arena Text1457†1485Kimi K3.1 Pro

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGLM-5 (thinking)Kimi K3.1 Pro
Blended price per 1M tokens$1.55$4.00
Input / output per 1M$1.00 / $3.20$2.00 / $10.00
Cached input per 1M$0.200$0.200
Price per task: chat reply$0.0014$0.0038
Price per task: summarize a 30-page report$0.014$0.030
Price per task: code edit$0.011$0.027
Price per task: agentic coding session$0.073$0.160
Price per task: structured extraction$0.0026$0.0060
Agentic coding session, input mostly cached$0.037$0.079
Cost per benchmark task (AA Index)–$3.68
Output tokens per task (AA Index)–72k
Of which reasoning–44k
Time per task (AA Index)–40 min
Output speed69 tok/s30 tok/s
Time to first answer29.2 s157.4 s
Time to a complete answer, last measured 13 Nov 202681.4 s417.5 s

Each model is compared at its best-ranked reasoning-effort setting. GLM-5 (thinking) scores 60.2 and takes 29 s to its first answer token; GLM-5 scores 54.9 in 2 s. Kimi K3.1 Pro scores 61.8 and takes 157 s to its first answer token; Kimi K3.1 Pro (max) scores 59.9 in 157 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

135 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGLM-5 (thinking)Kimi K3.1 Pro
BenchLeader IndexBenchLeader60.261.8
Agents & tools scoreBenchLeader58.064.6
Coding scoreBenchLeader59.159.6
Instruction following scoreBenchLeader70.9–
Knowledge scoreBenchLeader57.458.2
Long context scoreBenchLeader62.467.9
Maths scoreBenchLeader63.473.4
Reasoning scoreBenchLeader68.259.2
Multimodal scoreBenchLeader–66.3
Blended price $/MBenchLeader$1.55$4.00
Output speedBenchLeader69 tok/s30 tok/s
Time to first answerBenchLeader29.2 s157.4 s
Context windowBenchLeader204,800 tokens1,048,576 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub87.8%†–
SimpleBenchSimpleBench53.2%†–
Arena Hard PromptsArena (LMArena)1478†1504†
LiveBench 2.0 ReasoningLiveBench–91.1%†
GPQA Diamond (AA)Artificial Analysis82.0%–
Humanity's Last Exam (AA)Artificial Analysis29.3%52.5%
HLE-Diamond (AA)Artificial Analysis–37.3%
GPQA Diamond (Vals)Vals AI83.3%–
Kagi LLM BenchmarkKagi LLM Benchmark75.0%–
ARC-AGI-1ARC Prize44.7%†–
ARC-AGI-2ARC Prize4.9%†–
CritPtArtificial Analysis2.0%24.6%
CritPt v2 hard subset (AA)Artificial Analysis–49.5%
MysteryMechanismVals AI–26.1%†
Arena ExpertArena (LMArena)1482†1515†
CL-benchEpoch AI Benchmarking Hub18.7%†–
LMCAEpoch AI Benchmarking Hub–57.6%†
DTBenchEpoch AI Benchmarking Hub–93.3%†
ForecastBenchForecastBench63.4%†–
Coding
SWE-bench Verified (Epoch)Epoch AI Benchmarking Hub72.1%†–
SciCodeSciCode–60.8%
WeirdMLWeirdML48.2%†–
Arena CodingArena (LMArena)1498†1530†
Arena WebDevArena (LMArena)1435†1687†
LiveBench 2.0 CodingLiveBench–67.8%†
Show all 135 benchmarks
MetricPublisherGLM-5 (thinking)Kimi K3.1 Pro
Coding
LiveCodeBenchVals AI81.9%–
IOIVals AI–81.9%†
SWE-bench (Vals)Vals AI71.4%–
SWE-bench Verified (bash only)SWE-bench72.8%†–
SWE-bench Multilingual (bash only)SWE-bench69.7%†–
SWE-bench Verified (any scaffold)SWE-bench72.8%†–
Vibe Code Bench v1.1Vals AI23.4%84.9%†
SWE Atlas v1.0: Codebase QnAScale AI SEAL20.5%†–
SWE Atlas v1.0: RefactoringScale AI SEAL24.2%†–
SWE Atlas v1.0: Test WritingScale AI SEAL28.7%†–
SWE Atlas v1.1Scale AI SEAL–61.1%
SWE Atlas v1.1: Codebase QnAScale AI SEAL–70.2%
SWE Atlas v1.1: Test WritingScale AI SEAL–58.9%
SWE Atlas v1.1: RefactoringScale AI SEAL–54.3%
ALE-BenchEpoch AI Benchmarking Hub765.6†1932.8†
WeirdML v3WeirdML–9.9%†
Terminal-Bench 4.0 (AA)Artificial Analysis–67.2%
GameBench 2 OverallDuelLab GameBench 2–78.3
GameBench 2 by reasoning settingDuelLab GameBench 2–84.0†
Design Arena WebsiteDesign Arena1239†1321
FrontierCode 1.1 (AA)Artificial Analysis–47.1%
FrontierCode 2.0 (AA)Artificial Analysis–25.4%
Agents & tools
Terminal-BenchTerminal-Bench52.4%†59.7%†
APEX-AgentsMercor–65.5%
Arena AgentArena (LMArena)–4.9†
LiveBench Long AgenticLiveBench–38.7%†
LiveBench BrowserLiveBench–75.9%†
Terminal-Bench HardArtificial Analysis43.2%–
τ²-Bench Telecom (AA)Artificial Analysis98.3%–
HiL-BenchScale AI SEAL–61.3%
τ²-benchτ²-bench81.0%–
τ³-bench Bankingτ²-bench9.8%–
GDPval-AA v2.1, normalised scoreArtificial Analysis–67.3%
GDPval-AA v2.1Artificial Analysis–1861
Analyst Agent (AA)Artificial Analysis–38.8%
APEX-Agents (AA)Artificial Analysis14.4%–
Finance Agent v2.1Vals AI–61.5%†
Harvey's Legal Agent Benchmark v1.1Vals AI–11.7%†
Legal Research BenchVals AI–37.5%†
SREBenchVals AI–27.1%†
Tax Agent BenchVals AI–24.9%†
Terminal-Bench 2.0 (Vals)Vals AI49.4%–
Terminal-Bench 4.0 (Vals)Vals AI–63.6%†
Terminal-Bench ScienceVals AI–31.4%†
Arena Agent Task CompletionArena (LMArena)–2.7†
Vending-Bench 2Andon Labs4432.1†–
AutomationBenchArtificial Analysis–73.3%
GDP.pdf (AA)Artificial Analysis–31.4%
AA-Briefcase v1.1Artificial Analysis–1674
Design Arena AgenticDesign Arena1115†1301
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–34.3%
CWE-Bench (AA)Artificial Analysis–60.8%
DeepSec-Bench (AA)Artificial Analysis–36.7%
CyberGym end-to-end (AA)Artificial Analysis–94.7%
MKA (AA)Artificial Analysis–43.9%
Maths
OTIS Mock AIMEEpoch AI Benchmarking Hub80.0%†–
ProofBenchVals AI–91.0%
AIME (Vals)Vals AI91.7%–
AIME 2026MathArena96.7%†–
HMMT February 2026MathArena86.4%†–
USAMO 2026MathArena35.1%†–
MathArena ApexMathArena10.9%†–
ArXivMathMathArena–58.3%†
BrokenArXivMathArena–61.9%†
Arena MathsArena (LMArena)1443†–
Knowledge
LiveBench 2.0 Data AnalysisLiveBench–79.1%†
LiveBench ResearchLiveBench–82.1%†
AA-Omniscience v1.1Artificial Analysis–29.9
MMLU-ProVals AI86.0%–
LegalBenchVals AI84.1%–
CorpFinVals AI62.9%–
TaxEvalVals AI70.0%–
MedQAVals AI94.3%–
PRBench FinanceScale AI SEAL–47.5%
PRBench LegalScale AI SEAL–47.9%
BioMysteryBenchVals AI–75.6%†
CaseLaw v2Vals AI52.5%–
Excel Modeling Benchmark v1.1Vals AI–70.0%†
Access to Justice BenchmarkVals AI–69.5%†
DrugDiscoveryBenchScale AI SEAL–63.4%†
AA-Omniscience v1.1: accuracyArtificial Analysis–48.9%
AA-Omniscience v1.1: non-hallucinationArtificial Analysis–62.7%
Global-MMLU-Lite (AA)Artificial Analysis81.9%†–
Instruction following
IFBenchArtificial Analysis72.3%–
Arena Instruction FollowingArena (LMArena)1447†1487†
Human preference
Arena TextArena (LMArena)1457†1485†
EQ-Bench Creative Writing v3EQ-Bench1601†2173
Arena Creative WritingArena (LMArena)1447†1453†
Arena Multi-turnArena (LMArena)1472†1475†
Arena Longer QueriesArena (LMArena)1469†1491†
Multimodal
LiveBench DesignLiveBench–73.7%†
MMMU-ProArtificial Analysis–83.9%
Humanity's Sixth SenseScale AI SEAL–33.2%†
VIALS-AAHandshake AI–45.3%
AA-3DArtificial Analysis–1112
Long context
AA-LCR v1.1Artificial Analysis75.7%86.3%
MLCRArtificial Analysis–38.3%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub146.5†161.4
LiveBench 2.0LiveBench–68.7%†
AA Intelligence Index v5.0.1Artificial Analysis–46.5
AA Intelligence Index v4.3.2Artificial Analysis27.955.1
AA Progress Index v1Artificial Analysis280.9340.7
Vals IndexVals AI–62.5†
Vals Finance IndexVals AI–56.0%†
Vals Science IndexVals AI–44.4%†
Vals Legal IndexVals AI–67.0%†
AA Cyber IndexArtificial Analysis–64.1
Safety & honesty
FORTRESSScale AI SEAL–18.6%
DistressBenchScale AI SEAL71.2%†–
Metadata
AA Openness IndexArtificial Analysis5033.3

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Kimi K3.1 Pro: BenchLeader Index 61.2 → 61.8.
  • Kimi K3.1 Pro: 1 score revision.
  • Kimi K3.1 Pro: 1 score revision.
  • Kimi K3.1 Pro: 1 new result (HiL-Bench).
  • Kimi K3.1 Pro: 3 new results (PRBench Finance, PRBench Legal, FORTRESS); 2 score revisions.
  • Kimi K3.1 Pro: 2 new results (APEX-Agents, Epoch Capabilities Index).
  • Kimi K3.1 Pro: BenchLeader Index 61.8 → 61.2.
  • Kimi K3.1 Pro: 5 score revisions.
  • Kimi K3.1 Pro: BenchLeader Index 61.3 → 61.8.
  • GLM-5 (thinking): cached input price moved from $0.15/M to $0.20/M (34% up).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

GLM-5 vs Kimi K3.1 Pro: questions

Is GLM-5 better than Kimi K3.1 Pro?
GLM-5 (thinking) and Kimi K3.1 Pro are neck and neck on quality (60.2 vs 61.8, within the ±4.7 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 16 Nov 2026, so check the category scores for your use.
GLM-5 vs Kimi K3.1 Pro: which is cheaper, and will that change?
GLM-5 is cheaper today: $1.55 against $4.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is GLM-5 or Kimi K3.1 Pro better for coding?
They are level in coding (59 vs 60 on the category index).
Which is faster, GLM-5 or Kimi K3.1 Pro?
GLM-5 streams ~2× faster (69 vs 30 output tokens per second, Artificial Analysis 7-day median).
Is GLM-5 or Kimi K3.1 Pro better for agents and tool use?
Kimi K3.1 Pro scores higher in agentic tasks (65 vs 58 on the category index, where 50 is average).
More questions (4)
Which is better for long documents?
Kimi K3.1 Pro scores higher on long-context benchmarks (68 vs 62). Kimi K3.1 Pro accepts more context: 1,048,576 against 204,800 tokens for GLM-5.
Which has lower latency?
GLM-5 answers first: 29.2 s against 157.4 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Do independent benchmarks agree on GLM-5 vs Kimi K3.1 Pro?
Across the 5 benchmarks both have, GLM-5 leads 1, Kimi K3.1 Pro leads 4. Every overall index that rates both puts Kimi K3.1 Pro ahead.
When was Kimi K3.1 Pro released?
Kimi K3.1 Pro was released on 23 Oct 2026.