BenchLeader

GPT-5.1 vs Kimi K3

Verdict
  • Kimi K3 leads on quality: 66.5 vs 59.6.
  • GPT-5.1 is stronger in instruction following, reasoning.
  • Kimi K3 is stronger in agents & tools, coding, composite, human preference, knowledge, long context, multimodal, maths.
  • GPT-5.1 is 1.7× cheaper ($3.44 vs $6.00 per 1M blended).
  • GPT-5.1 streams 2.4× faster (91 vs 38 tokens per second).
MetricGPT-5.1Kimi K3
BenchLeader Index59.666.5
Agents & tools score55.767.4
Coding score47.165.0
Composite score60.374.2
Human preference score63.371.2
Instruction following score71.0
Knowledge score66.768.2
Long context score66.671.1
Multimodal score61.865.0
Reasoning score58.7
Maths score78.1
Blended price $/M$3.44$6.00
Output speed91 tok/s38 tok/s
Time to first answer43.1 s56.3 s
Context window400k1.0M
Humanity's Last Exam23.7%
Terminal-Bench47.6%
SciCode43.3%58.7%
APEX-Agents17.5%39.3%
FrontierCode44.2%
ProofBench87.0%
GSO-Bench13.7%
Epoch Capabilities Index149.7157.6
LMArena Text1439
LMArena Hard Prompts1456
LMArena Coding1475
LMArena WebDev1341
LMArena Vision1235
LiveBench79.2%
LiveBench Reasoning90.7%
LiveBench Coding81.5%
LiveBench Agentic Coding62.2%
LiveBench Mathematics84.4%
LiveBench Data Analysis78.7%
LiveBench Language85.5%
AA Intelligence Index24.743.8
IFBench72.9%
AA-LCR80.0%88.7%
MMMU-Pro75.5%80.5%
AA-Omniscience5.419.7
Terminal-Bench Hard45.5%
GPQA Diamond (AA)87.3%93.5%
Humanity's Last Exam (AA)28.5%46.9%
SciCode (AA)59.5%
τ²-Bench Telecom (AA)81.9%
LegalBench86.0%
CorpFin71.6%
TaxEval75.7%
Terminal-Bench 2.1 (Vals)80.9%
SWE-bench (Vals)93.4%
GPQA Diamond (Vals)92.9%
Vals Index57.8
EQ-Bench 41339
MMMU (validation)85.4%
MMMU-Pro (official)76.0%

Data as of 2026-09-10. Best configuration of each model; every score links to its source on the model pages.

GPT-5.1 vs Kimi K3: questions

Is GPT-5.1 better than Kimi K3?
Kimi K3 leads on quality: 66.5 vs 59.6. The BenchLeader Index combines every independent quality benchmark; Kimi K3 is ahead overall as of 2026-09-10, but check the category scores for your use.
Is GPT-5.1 better than Kimi K3 for coding?
Kimi K3 scores higher in coding (65 vs 47 on the category index, where 50 is average).
Is GPT-5.1 better than Kimi K3 for agentic tasks?
Kimi K3 scores higher in agentic tasks (67 vs 56 on the category index, where 50 is average).
Which is cheaper, GPT-5.1 or Kimi K3?
GPT-5.1 is cheaper: $3.44 against $6.00 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-5.1 or Kimi K3?
GPT-5.1 streams faster: 91 against 38 output tokens per second.
Which has the larger context window?
Kimi K3 accepts more context: 1.0M against 400k tokens.