BenchLeader

GLM 5.3 vs Kimi K3.1 Pro

Full profiles: GLM 5.3 (Zhipu AI) and Kimi K3.1 Pro (Moonshot AI): every benchmark, price and rank.

Updated · Data from 9 sources

As of 24 Oct 2026, GLM 5.3 (max) and Kimi K3.1 Pro are neck and neck on quality (63.5 vs 66.8 on the BenchLeader Index, inside the ±7.0 margin of error), and GLM 5.3 (max) costs 1.9× less, which makes it the better buy for most workloads. Kimi K3.1 Pro leads in every category we measure both in.

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
Agents & tool useKimi K3.1 Pro67 vs 58 category score; CWE-Bench (AA) 60.8% vs 55.8%High
ReasoningKimi K3.1 Pro81 vs 69 category score; CritPt 24.6% vs 19.1%High
KnowledgeKimi K3.1 Pro75 vs 59 category score; AA-Omniscience 29.5 vs 14.3High
Long documentsKimi K3.1 Pro68 vs 65 category score; AA-LCR 86.3% vs 79.7%Medium
Chat quality (human preference)–Only GLM 5.3 has an Arena rating (67 category score)Not comparable
Lowest costGLM 5.3$2.15 vs $4.00 per 1M blended; agentic coding session $0.102 vs $0.160–
Fastest first answerEither26.5 s (GLM 5.3 (max)) vs 27.7 s (Kimi K3.1 Pro) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GLM 5.3 (max) and Kimi K3.1 Pro are neck and neck on quality (63.5 vs 66.8, within the ±7.0 margin).
  • GLM 5.3 (max) is stronger in coding, composite, human preference, maths.
  • Kimi K3.1 Pro is stronger in agents & tools, knowledge, long context, reasoning, multimodal.
  • GLM 5.3 (max) is 1.9× cheaper ($2.15 vs $4.00 per 1M blended).

At a glance

SpecGLM 5.3Kimi K3.1 Pro
DeveloperZhipu AIMoonshot AI
Released18 Aug 202623 Oct 2026
Context window (tokens)1,000,0001,048,576
Compared atGLM 5.3 (max)Kimi K3.1 Pro
Open weightsYesNo
Price in / out / cached input per 1M$1.40 / $4.40 / $0.260$2.00 / $10.00 / $0.200

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGLM 5.3 (max)Kimi K3.1 ProLeader
Reasoning68.581.3Kimi K3.1 Pro
Coding62.0–not comparable
Agents & tools57.567.3Kimi K3.1 Pro
Maths60.4–not comparable
Knowledge58.574.8Kimi K3.1 Pro
Human preference67.3–not comparable
Multimodal–67.0not comparable
Long context64.968.3Kimi K3.1 Pro
Composite79.675.8GLM 5.3

Where sources disagree

Across the 17 benchmarks both have, GLM 5.3 leads 1, Kimi K3.1 Pro leads 16. Every overall index that rates both puts Kimi K3.1 Pro ahead.

Overall indexGLM 5.3 (max)Kimi K3.1 ProLeader
BenchLeader Index63.566.8neck and neck
AA Intelligence Index v4.3.244.855.1Kimi K3.1 Pro

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureGLM 5.3 (max)Kimi K3.1 Pro
Blended price per 1M tokens$2.15$4.00
Input / output per 1M$1.40 / $4.40$2.00 / $10.00
Cached input per 1M$0.260$0.200
Price per task: chat reply$0.0019$0.0038
Price per task: summarize a 30-page report$0.019$0.030
Price per task: code edit$0.015$0.027
Price per task: agentic coding session$0.102$0.160
Price per task: structured extraction$0.0037$0.0060
Cost to run a full benchmark suite$2.01$2.11
Output speed85 tok/s81 tok/s
Time to first answer26.5 s27.7 s
Time to a complete answer32.4 s33.9 s

Per token is not per task: on Artificial Analysis' full suite GLM 5.3 (max) cost $2.01 and Kimi K3.1 Pro $2.11, because GLM 5.3 (max) used about 1.8× as many tokens for the same work, which a per-token price hides.

Each model is compared at its best-ranked reasoning-effort setting. GLM 5.3 (max) scores 63.5 and takes 27 s to its first answer token; GLM 5.3 (low) scores 55.6 in 25 s. Kimi K3.1 Pro scores 66.8 and takes 28 s to its first answer token. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

116 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGLM 5.3 (max)Kimi K3.1 Pro
BenchLeader IndexBenchLeader63.566.8
Agents & tools scoreBenchLeader57.567.3
Coding scoreBenchLeader62.0–
Composite scoreBenchLeader79.675.8
Human preference scoreBenchLeader67.3–
Knowledge scoreBenchLeader58.574.8
Long context scoreBenchLeader64.968.3
Maths scoreBenchLeader60.4–
Reasoning scoreBenchLeader68.581.3
Multimodal scoreBenchLeader–67.0
Blended price $/MBenchLeader$2.15$4.00
Output speedBenchLeader85 tok/s81 tok/s
Time to first answerBenchLeader26.5 s27.7 s
Context windowBenchLeader1,000,000 tokens1,048,576 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub90.9%–
Arena Hard PromptsArena (LMArena)1505–
LiveBench 2.0 ReasoningLiveBench85.8%†91.1%
LiveBench 1.0 ReasoningLiveBench85.8%†–
GPQA Diamond (AA)Artificial Analysis91.7%–
Humanity's Last Exam (AA)Artificial Analysis42.3%52.5%
GPQA Diamond (Vals)Vals AI88.1%–
CritPtArtificial Analysis19.1%24.6%
MysteryMechanismVals AI23.0%–
Chess PuzzlesEpoch AI Benchmarking Hub37.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub33.0%–
LMCAEpoch AI Benchmarking Hub55.5%†–
DTBenchEpoch AI Benchmarking Hub87.7%†–
BTF-3Epoch AI Benchmarking Hub14.9%†–
Coding
SciCodeSciCode59.0%–
WeirdMLWeirdML75.4%–
FrontierCodeCognition40.1%–
Arena CodingArena (LMArena)1521–
Arena WebDevArena (LMArena)1623–
LiveBench 2.0 CodingLiveBench82.8%†81.8%
LiveBench 1.0 CodingLiveBench79.0%†–
SciCode (AA)Artificial Analysis59.0%60.8%
LiveCodeBenchVals AI80.5%–
IOIVals AI68.4%–
SWE-bench (Vals)Vals AI95.4%–
Show all 116 benchmarks
MetricPublisherGLM 5.3 (max)Kimi K3.1 Pro
Coding
Code MigrationVals AI44.2%–
Code Migration v1.1Vals AI55.1%–
ProgramBenchVals AI1.5%–
Vibe Code Bench 1-100Vals AI20.0%–
Vibe Code Bench v1.1Vals AI78.1%–
DeepSWE v1.1Epoch AI Benchmarking Hub69.0%–
CursorBenchCursor42.6%–
ALE-BenchEpoch AI Benchmarking Hub1317.4†–
FrontierSWEEpoch AI Benchmarking Hub30.2%–
Terminal-Bench 4.0 (AA)Artificial Analysis41.9%67.2%
Terminal-Bench 2.1 (AA)Artificial Analysis83.9%–
Startrise FrontendStartrise73.2%†–
FrontierCode 1.1 (AA)Artificial Analysis40.1%47.1%
Agents & tools
Terminal-BenchTerminal-Bench41.8%–
APEX-AgentsMercor56.6%†–
Arena AgentArena (LMArena)1.4–
LiveBench Long AgenticLiveBench35.9%†49.5%
LiveBench BrowserLiveBench0.0%†80.0%
LiveBench Agentic CodingLiveBench60.9%†–
Terminal-Bench 2.1 (Vals)Vals AI71.5%–
MCP AtlasScale AI SEAL84.2%†–
HiL-BenchScale AI SEAL58.3%†–
GDPval-AA v2.1Artificial Analysis57.5%67.3%
τ³-Banking (AA)Artificial Analysis50.3%–
ITBench SRE (AA)Artificial Analysis46.1%–
Analyst Agent (AA)Artificial Analysis38.8%–
CyberBenchVals AI72.1%–
Finance Agent v2Vals AI55.8%–
Finance Agent v2.1Vals AI65.0%–
Harvey's Legal Agent Benchmark v1.1Vals AI14.6%–
Harvey's Legal Agent Benchmark v1Vals AI8.3%–
Legal Research BenchVals AI49.0%–
SkillsBenchVals AI47.5%–
SREBenchVals AI9.2%–
Tax Agent BenchVals AI39.7%–
Terminal-Bench 4.0 (Vals)Vals AI38.9%–
Terminal-Bench ScienceVals AI5.7%–
Vending-Bench 2Andon Labs8163.6†–
AutomationBenchArtificial Analysis62.2%73.3%
GDP.pdf (AA)Artificial Analysis11.2%31.4%
Harvey LAB-AA v1.1Harvey0.3%–
EnterpriseOps-GymArtificial Analysis36.4%–
AA-Briefcase v1.1Artificial Analysis15051678
Terminal-Bench-Science 0.1 (AA)Artificial Analysis9.5%–
CWE-Bench (AA)Artificial Analysis55.8%60.8%
DeepSec-Bench (AA)Artificial Analysis24.3%36.7%
CyberGym end-to-end (AA)Artificial Analysis29.0%94.7%
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub68.8%–
FrontierMath Tier 4Epoch AI Benchmarking Hub29.3%–
OTIS Mock AIMEEpoch AI Benchmarking Hub91.1%–
ProofBenchVals AI49.0%–
LiveBench MathematicsLiveBench87.9%†–
Arena MathsArena (LMArena)1500–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub41.0%–
LiveBench 2.0 Data AnalysisLiveBench70.2%†79.1%
LiveBench ResearchLiveBench73.2%†77.9%
LiveBench 1.0 Data AnalysisLiveBench70.2%†–
AA-OmniscienceArtificial Analysis14.329.5
MMLU-ProVals AI86.8%–
LegalBenchVals AI84.8%–
TaxEvalVals AI72.4%–
Excel Modeling BenchmarkVals AI56.3%–
Excel Modeling Benchmark v1.1Vals AI69.1%–
MedCodeVals AI42.9%–
MedScribeVals AI88.8%–
Public Benefits Bench v1.1Vals AI68.5%–
AA-Omniscience: accuracyArtificial Analysis33.9%51.0%
AA-Omniscience: non-hallucinationArtificial Analysis70.5%56.1%
Instruction following
LiveBench LanguageLiveBench79.9%†–
LiveBench Instruction FollowingLiveBench69.3%†–
Arena Instruction FollowingArena (LMArena)1478–
Human preference
Arena TextArena (LMArena)1481–
Arena Creative WritingArena (LMArena)1456–
Arena Multi-turnArena (LMArena)1478–
Arena Longer QueriesArena (LMArena)1486–
Multimodal
LiveBench DesignLiveBench77.3%†77.8%
MMMU-ProArtificial Analysis–83.9%
AA-3DArtificial Analysis787–
Long context
AA-LCRArtificial Analysis79.7%86.3%
MLCRArtificial Analysis17.2%–
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub156.0†–
LiveBench 2.0LiveBench60.7%†76.7%
LiveBench 1.0LiveBench76.1%†–
AA Intelligence Index v4.3.2Artificial Analysis44.855.1
Vals IndexVals AI59.7–
Vals Finance IndexVals AI60.5%–
Vals RSI IndexVals AI22.9%–
Vals Router IndexVals AI59.7%†–
AA Cyber IndexArtificial Analysis36.464.1
Safety & honesty
FORTRESSScale AI SEAL28.2%–
Metadata
AA Openness IndexArtificial Analysis33.3–

Data as of 2026-10-24. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Kimi K3.1 Pro: BenchLeader Index 65.6 → 66.8.
  • GLM 5.3 (max): cached input price moved from $0.30/M to $0.26/M (13% down).
  • Kimi K3.1 Pro: 5 new results (FrontierCode 1.1 (AA), AA Cyber Index, CWE-Bench (AA)…).
  • GLM 5.3 (max): 6 new results (Code Migration v1.1, Excel Modeling Benchmark v1.1, Finance Agent v2.1…).
  • Kimi K3.1 Pro: first results.
  • GLM 5.3 (max): 1 score revision.
  • GLM 5.3 (max): 4 score revisions; cached input price moved from $0.26/M to $0.30/M (15% up).
  • GLM 5.3 (max): 1 score revision.
  • GLM 5.3 (max): 1 new result (SREBench); 2 score revisions.
  • GLM 5.3 (max): 1 new result (Analyst Agent (AA)); 1 score revision.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

GLM 5.3 vs Kimi K3.1 Pro: questions

Is GLM 5.3 better than Kimi K3.1 Pro?
GLM 5.3 (max) and Kimi K3.1 Pro are neck and neck on quality (63.5 vs 66.8, within the ±7.0 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 2026-10-24, so check the category scores for your use.
Which is cheaper, GLM 5.3 or Kimi K3.1 Pro, and will that change?
GLM 5.3 is cheaper today: $2.15 against $4.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is GLM 5.3 better than Kimi K3.1 Pro for agents and tool use?
Kimi K3.1 Pro scores higher in agentic tasks (67 vs 58 on the category index, where 50 is average). On CWE-Bench (AA), the top shared agents & tools benchmark, it is 55.8% for GLM 5.3 against 60.8% for Kimi K3.1 Pro.
Which is better for long documents?
Kimi K3.1 Pro scores higher on long-context benchmarks (68 vs 65). Both take about 1M tokens: GLM 5.3 1,000,000, Kimi K3.1 Pro 1,048,576.
Which has lower latency?
GLM 5.3 (max) answers first: 26.5 s against 27.7 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Which is faster, GLM 5.3 or Kimi K3.1 Pro?
GLM 5.3 streams faster: 85 against 81 output tokens per second.
Do independent benchmarks agree on GLM 5.3 vs Kimi K3.1 Pro?
Across the 17 benchmarks both have, GLM 5.3 leads 1, Kimi K3.1 Pro leads 16. Every overall index that rates both puts Kimi K3.1 Pro ahead.
When was Kimi K3.1 Pro released?
Kimi K3.1 Pro was released on 23 Oct 2026.