BenchLeader
Menu
Best LLMsChoose a modelCoding plansLeaderboardsModelsBenchmarksProvidersReleases12

GPT-6 Sol vs Kimi K3.1 Pro Together

Full profiles: GPT-6 Sol (OpenAI) and Kimi K3.1 Pro Together (Moonshot AI): every benchmark, price and rank.

Updated · Data from 10 sources

As of 9 Nov 2026, GPT-6 Sol and Kimi K3.1 Pro Together are neck and neck on quality (62.9 vs 60.5 on the BenchLeader Index, inside the ±3.9 margin). Choose GPT-6 Sol for maths (69 vs 66); choose Kimi K3.1 Pro Together for knowledge (68 vs 62).

Key facts (as of 9 Nov 2026)

  • GPT-6 Sol scores 62.9 on the BenchLeader Index and Kimi K3.1 Pro Together scores 60.5 (BenchLeader, 9 Nov 2026).
  • GPT-6 Sol costs $4.00 per 1M tokens blended (list price, 9 Nov 2026).
  • Of the 7 benchmarks both models have, GPT-6 Sol leads 5 (BenchLeader, 9 Nov 2026).
GPT-6 Sol benchmarks max OpenAI Kimi K3.1 Pro Together benchmarks max Moonshot AIAdd a third model

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
MathsGPT-6 Sol69 vs 66 category score; FrontierMath Tiers 1–3 89.8% vs 78.3%Medium
ReasoningEither66 vs 67 category score; GPQA Diamond 94.3% vs 94.2%Either
KnowledgeKimi K3.1 Pro Together68 vs 62 category score; SimpleQA Verified 62.2% vs 60.7%Medium
Chat quality (human preference)–Only GPT-6 Sol has an Arena rating (64 category score)Not comparable
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GPT-6 Sol (max) and Kimi K3.1 Pro Together (max) are neck and neck on quality (62.9 vs 60.5, within the ±3.9 margin).
  • GPT-6 Sol (max) is stronger in agents & tools, coding, human preference, long context, maths, multimodal.
  • Kimi K3.1 Pro Together (max) is stronger in knowledge, reasoning.

At a glance

SpecGPT-6 SolKimi K3.1 Pro Together
DeveloperOpenAIMoonshot AI
Released22 Sep 202623 Oct 2026
Context window (tokens)1,050,000–
Compared atGPT-6 Sol (max)Kimi K3.1 Pro Together (max)
Open weightsNoNo
Price in / out / cached input per 1M$2.00 / $10.00 / $0.200–

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGPT-6 Sol (max)Kimi K3.1 Pro Together (max)Leader
Reasoning66.267.1level
Coding66.5–not comparable
Agents & tools59.6–not comparable
Maths68.565.8GPT-6 Sol
Knowledge61.567.6Kimi K3.1 Pro Together
Human preference64.2–not comparable
Multimodal60.7–not comparable
Long context66.6–not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningMathsKnowledgeGPT-6 Sol, Reasoning: 66.2GPT-6 Sol, Maths: 68.5GPT-6 Sol, Knowledge: 61.5Kimi K3.1 Pro Together, Reasoning: 67.1Kimi K3.1 Pro Together, Maths: 65.8Kimi K3.1 Pro Together, Knowledge: 67.6

Not drawn, measured for fewer than two of these models: Coding, Agents & tools, Instruction following, Long context, Multimodal, Human preference.

ModelIndex

Where sources disagree

Across the 7 benchmarks both have, GPT-6 Sol leads 5, Kimi K3.1 Pro Together leads 1 and 1 is a tie.

Overall indexGPT-6 Sol (max)Kimi K3.1 Pro Together (max)Leader
BenchLeader Index62.960.5neck and neck

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGPT-6 Sol (max)Kimi K3.1 Pro Together (max)
Blended price per 1M tokens$4.00–
Input / output per 1M$2.00 / $10.00– / –
Cached input per 1M$0.200–
Price per task: chat reply$0.0038–
Price per task: summarize a 30-page report$0.030–
Price per task: code edit$0.027–
Price per task: agentic coding session$0.160–
Price per task: structured extraction$0.0060–
Agentic coding session, input mostly cached$0.079–
Cost per benchmark task (AA Index)$2.47–
Output tokens per task (AA Index)54k–
Of which reasoning35k–
Time per task (AA Index)7 min–
Output speed121 tok/s–
Time to first answer72.1 s–
Time to a complete answer130.2 s–

Each model is compared at its best-ranked reasoning-effort setting. GPT-6 Sol (max) scores 62.9 and takes 72 s to its first answer token; GPT-6 Sol (xhigh) scores 58.6 in 24 s, GPT-6 Sol (high) scores 58.2 in 9 s. Kimi K3.1 Pro Together (max) scores 60.5. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

97 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGPT-6 Sol (max)Kimi K3.1 Pro Together (max)
BenchLeader IndexBenchLeader62.960.5
Agents & tools scoreBenchLeader59.6–
Coding scoreBenchLeader66.5–
Human preference scoreBenchLeader64.2–
Knowledge scoreBenchLeader61.567.6
Long context scoreBenchLeader66.6–
Maths scoreBenchLeader68.565.8
Multimodal scoreBenchLeader60.7–
Reasoning scoreBenchLeader66.267.1
Blended price $/MBenchLeader$4.00–
Output speedBenchLeader121 tok/s–
Time to first answerBenchLeader72.1 s–
Context windowBenchLeader1,050,000 tokens–
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub94.3%94.2%
Arena Hard PromptsArena (LMArena)1483–
LiveBench 1.0 ReasoningLiveBench88.7%–
Humanity's Last Exam (AA)Artificial Analysis47.9%–
HLE-Diamond (AA)Artificial Analysis45.2%–
ARC-AGI-1ARC Prize95.5%–
ARC-AGI-2ARC Prize89.6%–
ARC-AGI-3ARC Prize23.0%–
CritPtArtificial Analysis30.9%–
CritPt v2 hard subset (AA)Artificial Analysis66.5%–
MysteryMechanismVals AI30.2%–
Chess PuzzlesEpoch AI Benchmarking Hub56.0%45.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub56.0%42.0%
LMCAEpoch AI Benchmarking Hub59.1%–
DTBenchEpoch AI Benchmarking Hub97.3%–
Coding
SciCodeSciCode57.6%–
FrontierCodeCognition49.3%–
Arena CodingArena (LMArena)1520–
Arena WebDevArena (LMArena)1674–
LiveBench 1.0 CodingLiveBench81.8%–
IOIVals AI82.6%–
Code MigrationVals AI57.2%–
ProgramBenchVals AI2.0%–
Vibe Code Bench v1.1Vals AI87.8%–
ALE-BenchEpoch AI Benchmarking Hub2462–
Show all 97 benchmarks
MetricPublisherGPT-6 Sol (max)Kimi K3.1 Pro Together (max)
Coding
Terminal-Bench 4.0 (AA)Artificial Analysis43.9%–
GameBench 2 OverallDuelLab GameBench 272.9†–
GameBench 2 by reasoning settingDuelLab GameBench 279.3†–
Design Arena WebsiteDesign Arena1285†–
FrontierCode 2.0 (AA)Artificial Analysis35.6%–
Agents & tools
Terminal-BenchTerminal-Bench50.3%–
APEX-AgentsMercor54.3%–
Arena AgentArena (LMArena)7–
LiveBench Agentic CodingLiveBench52.9%–
Terminal-Bench 2.1 (Vals)Vals AI83.2%–
ITBench SRE (AA)Artificial Analysis49.4%–
CyberBenchVals AI78.0%–
Finance Agent v2Vals AI49.0%–
Harvey's Legal Agent Benchmark v1Vals AI1.7%–
Legal Research BenchVals AI28.9%–
SREBenchVals AI30.5%–
Tax Agent BenchVals AI15.0%–
Terminal-Bench 4.0 (Vals)Vals AI44.4%–
Terminal-Bench ScienceVals AI30.0%–
Arena SearchArena (LMArena)1229–
Vending-Bench 2Andon Labs14427.9†–
AutomationBenchArtificial Analysis61.6%–
GDP.pdf (AA)Artificial Analysis25.2%–
Harvey LAB-AA v1.1Harvey3.6%–
AA-Briefcase v1.1Artificial Analysis1476–
Design Arena AgenticDesign Arena1212†–
Terminal-Bench-Science 0.1 (AA)Artificial Analysis30.0%–
CWE-Bench (AA)Artificial Analysis64.2%–
DeepSec-Bench (AA)Artificial Analysis46.3%–
CyberGym end-to-end (AA)Artificial Analysis0.0%–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub89.8%78.3%
FrontierMath Tier 4Epoch AI Benchmarking Hub90.0%65.8%
OTIS Mock AIMEEpoch AI Benchmarking Hub100.0%100.0%
ProofBenchVals AI83.0%†–
LiveBench MathematicsLiveBench96.4%–
Arena MathsArena (LMArena)1440–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub60.7%62.2%
LiveBench 1.0 Data AnalysisLiveBench81.2%–
AA-Omniscience v1.1Artificial Analysis21.4–
PRBench LegalScale AI SEAL38.6%†–
BioMysteryBenchVals AI74.8%–
Excel Modeling BenchmarkVals AI71.5%–
MedCodeVals AI47.1%–
MedScribeVals AI82.0%–
Public Benefits Bench v1.1Vals AI56.6%–
EBR-benchEpoch AI Benchmarking Hub53.3%–
GDP.pdfEpoch AI Benchmarking Hub26.4%–
AA-Omniscience v1.1: accuracyArtificial Analysis51.1%–
AA-Omniscience v1.1: non-hallucinationArtificial Analysis39.1%–
HealthBench Professional (AA)OpenAI62.3%–
Instruction following
LiveBench LanguageLiveBench85.3%–
LiveBench Instruction FollowingLiveBench68.6%–
Arena Instruction FollowingArena (LMArena)1448–
Human preference
Arena TextArena (LMArena)1457–
Arena Creative WritingArena (LMArena)1430–
Arena Multi-turnArena (LMArena)1466–
Arena Longer QueriesArena (LMArena)1466–
Multimodal
Arena VisionArena (LMArena)1232–
MMMU-ProArtificial Analysis83.0%–
Blueprint-Bench 2Epoch AI Benchmarking Hub36.9%†–
AA-3DArtificial Analysis1131–
Long context
AA-LCR v1.1Artificial Analysis83.7%–
MLCRArtificial Analysis33.9%–
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub164.1†–
LiveBench 1.0LiveBench79.3%–
AA Intelligence Index v5.0Artificial Analysis44.2–
AA Intelligence Index v4.3.2Artificial Analysis47.6–
AA Progress Index v1Artificial Analysis334–
Vals RSI IndexVals AI28.1%–
Vals Science IndexVals AI45.0%–
AA Cyber IndexArtificial Analysis36.8–
Safety & honesty
FORTRESSScale AI SEAL13.5%†–

Data as of 2026-11-09. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261103-eaea31df94e6 (https://benchmarks.duellab.org/releases/gb2-20261103-eaea31df94e6/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • GPT-6 Sol (max): BenchLeader Index 63.5 → 62.9.
  • GPT-6 Sol (max): 2 score revisions.
  • GPT-6 Sol (max): 1 score revision.
  • Kimi K3.1 Pro Together (max): first results.
  • GPT-6 Sol (max): 1 score revision.
  • GPT-6 Sol (max): 6 new results (AA Intelligence Index v5.0, AA-Omniscience v1.1, CritPt v2 hard subset (AA)…).
  • GPT-6 Sol (max): 1 score revision.
  • GPT-6 Sol (max): 1 score revision.
  • GPT-6 Sol (max): BenchLeader Index 64.1 → 63.5.
  • GPT-6 Sol (max): 2 new results (AA Progress Index v1, HLE-Diamond (AA)).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

GPT-6 Sol vs Kimi K3.1 Pro Together: questions

Is GPT-6 Sol better than Kimi K3.1 Pro Together?
GPT-6 Sol (max) and Kimi K3.1 Pro Together (max) are neck and neck on quality (62.9 vs 60.5, within the ±3.9 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 9 Nov 2026, so check the category scores for your use.
Do independent benchmarks agree on GPT-6 Sol vs Kimi K3.1 Pro Together?
Across the 7 benchmarks both have, GPT-6 Sol leads 5, Kimi K3.1 Pro Together leads 1 and 1 is a tie.
When was Kimi K3.1 Pro Together released?
Kimi K3.1 Pro Together was released on 23 Oct 2026.