BenchLeader

GPT-5.6 Sol vs Kimi K3

Verdict
  • GPT-5.6 Sol (high) leads on quality: 68.0 vs 66.5.
  • GPT-5.6 Sol (high) is stronger in agents & tools, coding, composite, instruction following, knowledge, multimodal, reasoning.
  • Kimi K3 is stronger in long context, human preference, maths.
  • Kimi K3 is 1.3× cheaper ($6.00 vs $8.00 per 1M blended).
  • GPT-5.6 Sol (high) streams 1.6× faster (59 vs 37 tokens per second).
MetricGPT-5.6 Sol (high)Kimi K3
BenchLeader Index68.066.5
Agents & tools score87.667.5
Coding score72.064.9
Composite score82.574.1
Instruction following score67.6
Knowledge score73.768.1
Long context score67.471.1
Multimodal score66.565.1
Reasoning score62.9
Human preference score71.2
Maths score78.1
Blended price $/M$8.00$6.00
Output speed59 tok/s37 tok/s
Time to first answer31.4 s57.7 s
Context window1M1.0M
SciCode56.9%58.7%
WeirdML88.8%
APEX-Agents39.3%
FrontierCode44.2%
ProofBench87.0%
Epoch Capabilities Index157.6
LiveBench79.2%
LiveBench Reasoning90.7%
LiveBench Coding81.5%
LiveBench Agentic Coding62.2%
LiveBench Mathematics84.4%
LiveBench Data Analysis78.7%
LiveBench Language85.5%
AA Intelligence Index42.543.8
IFBench69.2%
AA-LCR81.7%88.7%
MMMU-Pro81.8%80.5%
AA-Omniscience20.419.7
Terminal-Bench Hard62.1%
GPQA Diamond (AA)92.8%93.5%
Humanity's Last Exam (AA)46.0%46.9%
SciCode (AA)57.8%59.5%
τ²-Bench Telecom (AA)83.3%
LegalBench86.0%
CorpFin71.6%
TaxEval75.7%
Terminal-Bench 2.1 (Vals)80.9%
SWE-bench (Vals)93.4%
GPQA Diamond (Vals)92.9%
Vals Index57.8
EnigmaEval37.1%
EQ-Bench 41339
ARC-AGI-197.0%
ARC-AGI-285.4%
ARC-AGI-32.2%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.