BenchLeader

GPT-5.4 Pro vs Kimi K2.6

Verdict
  • GPT-5.4 Pro leads on quality: 64.3 vs 60.7.
  • GPT-5.4 Pro is stronger in knowledge, multimodal, reasoning.
  • Kimi K2.6 is stronger in instruction following, agents & tools, coding, composite, human preference, long context, maths.
  • Kimi K2.6 is 39× cheaper ($1.71 vs $67.50 per 1M blended).
  • Kimi K2.6 streams 44.4× faster (44 vs 1 tokens per second).
MetricGPT-5.4 ProKimi K2.6
BenchLeader Index64.360.7
Instruction following score67.373.7
Knowledge score73.658.6
Multimodal score69.863.7
Reasoning score75.366.0
Agents & tools score45.1
Coding score60.4
Composite score68.6
Human preference score60.8
Long context score67.1
Maths score53.8
Blended price $/M$67.50$1.71
Output speed1 tok/s44 tok/s
Time to first answer6.5 s103.2 s
Context window1.1M262k
GPQA Diamond90.8%
FrontierMath Tiers 1–357.2%
FrontierMath Tier 425.6%
OTIS Mock AIME96.1%
SWE-bench Verified (Epoch)76.7%
SimpleQA Verified34.9%
Humanity's Last Exam44.3%
SimpleBench74.1%
OSWorld-Verified 2.04.6%
SciCode53.5%
WeirdML55.9%
APEX-Agents18.9%
ProofBench16.0%
Epoch Capabilities Index158.9151.0
LMArena Text1461
LMArena Hard Prompts1485
LMArena Coding1514
LMArena WebDev1509
LMArena Vision1281
AA Intelligence Index31.3
IFBench76.0%
AA-LCR81.0%
MMMU-Pro79.4%
AA-Omniscience5.3
Terminal-Bench Hard43.9%
GPQA Diamond (AA)91.1%
Humanity's Last Exam (AA)37.5%
SciCode (AA)51.5%
τ²-Bench Telecom (AA)95.9%
LiveCodeBench86.8%
MMLU-Pro87.6%
LegalBench84.7%
CorpFin66.7%
TaxEval74.7%
Terminal-Bench 2.1 (Vals)53.6%
SWE-bench (Vals)76.2%
GPQA Diamond (Vals)89.1%
Vals Index43.5
MultiChallenge69.2%
VISTA53.9%
MultiNRC62.3%
HiL-Bench18.7%
TutorBench56.6%
EQ-Bench 41202

Data as of 2026-09-10. Best configuration of each model; every score links to its source on the model pages.

GPT-5.4 Pro vs Kimi K2.6: questions

Is GPT-5.4 Pro better than Kimi K2.6?
GPT-5.4 Pro leads on quality: 64.3 vs 60.7. The BenchLeader Index combines every independent quality benchmark; GPT-5.4 Pro is ahead overall as of 2026-09-10, but check the category scores for your use.
Which is cheaper, GPT-5.4 Pro or Kimi K2.6?
Kimi K2.6 is cheaper: $1.71 against $67.50 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-5.4 Pro or Kimi K2.6?
Kimi K2.6 streams faster: 44 against 1 output tokens per second.
Which has the larger context window?
GPT-5.4 Pro accepts more context: 1.1M against 262k tokens.