BenchLeader

Kimi K3.1 Pro vs Muse Spark

Full profiles: Kimi K3.1 Pro (Moonshot AI) and Muse Spark (Meta): every benchmark, price and rank.

Updated · Data from 8 sources

As of 24 Oct 2026, Kimi K3.1 Pro and Muse Spark are neck and neck on quality (66.8 vs 64.3, inside the ±6.9 margin of error) and close on price, so pick on the category that matters to you. Kimi K3.1 Pro leads in every category we measure both in.

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
Agents & tool useKimi K3.1 Pro67 vs 66 category scoreMedium
ReasoningKimi K3.1 Pro81 vs 65 category score; CritPt 24.6% vs 11.3%High
KnowledgeKimi K3.1 Pro75 vs 63 category score; AA-Omniscience 29.5 vs 7.2High
Long documentsKimi K3.1 Pro68 vs 64 category score; AA-LCR 86.3% vs 78.0%Medium
Images and other mediaKimi K3.1 Pro67 vs 65 category score; MMMU-Pro 83.9% vs 80.5%Medium
Chat quality (human preference)–Only Muse Spark has an Arena rating (68 category score)Not comparable
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Kimi K3.1 Pro and Muse Spark are neck and neck on quality (66.8 vs 64.3, within the ±6.9 margin).
  • Kimi K3.1 Pro is stronger in agents & tools, composite, knowledge, long context, multimodal, reasoning.
  • Muse Spark is stronger in coding, human preference, instruction following, maths.

At a glance

SpecKimi K3.1 ProMuse Spark
DeveloperMoonshot AIMeta
Released23 Oct 20268 Apr 2026
Context window (tokens)1,048,576262,144
Compared atKimi K3.1 ProMuse Spark
Open weightsNoNo
Price in / out / cached input per 1M$2.00 / $10.00 / $0.200–

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryKimi K3.1 ProMuse SparkLeader
Reasoning81.365.3Kimi K3.1 Pro
Coding–65.0not comparable
Agents & tools67.366.1Kimi K3.1 Pro
Maths–59.1not comparable
Knowledge74.863.3Kimi K3.1 Pro
Instruction following–77.3not comparable
Human preference–68.3not comparable
Multimodal67.064.5Kimi K3.1 Pro
Long context68.364.0Kimi K3.1 Pro
Composite75.864.5Kimi K3.1 Pro

Where sources disagree

Across the 7 benchmarks both have, Kimi K3.1 Pro leads 7, Muse Spark leads 0. Every overall index that rates both puts Kimi K3.1 Pro ahead.

Overall indexKimi K3.1 ProMuse SparkLeader
BenchLeader Index66.864.3neck and neck
AA Intelligence Index v4.3.255.131.3Kimi K3.1 Pro

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureKimi K3.1 ProMuse Spark
Blended price per 1M tokens$4.00–
Input / output per 1M$2.00 / $10.00– / –
Cached input per 1M$0.200–
Price per task: chat reply$0.0038–
Price per task: summarize a 30-page report$0.030–
Price per task: code edit$0.027–
Price per task: agentic coding session$0.160–
Price per task: structured extraction$0.0060–
Cost to run a full benchmark suite$2.11–
Output speed81 tok/s–
Time to first answer27.7 s–
Time to a complete answer33.9 s–

Each model is compared at its best-ranked reasoning-effort setting. Kimi K3.1 Pro scores 66.8 and takes 28 s to its first answer token. Muse Spark scores 64.3. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

73 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherKimi K3.1 ProMuse Spark
BenchLeader IndexBenchLeader66.864.3
Agents & tools scoreBenchLeader67.366.1
Composite scoreBenchLeader75.864.5
Knowledge scoreBenchLeader74.863.3
Long context scoreBenchLeader68.364.0
Multimodal scoreBenchLeader67.064.5
Reasoning scoreBenchLeader81.365.3
Coding scoreBenchLeader–65.0
Human preference scoreBenchLeader–68.3
Instruction following scoreBenchLeader–77.3
Maths scoreBenchLeader–59.1
Blended price $/MBenchLeader$4.00–
Output speedBenchLeader81 tok/s–
Time to first answerBenchLeader27.7 s–
Context windowBenchLeader1,048,576 tokens262,144 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub–89.8%
Humanity's Last ExamScale AI / CAIS–40.6%
Arena Hard PromptsArena (LMArena)–1506
LiveBench 2.0 ReasoningLiveBench91.1%–
GPQA Diamond (AA)Artificial Analysis–88.4%
Humanity's Last Exam (AA)Artificial Analysis52.5%40.7%
GPQA Diamond (Vals)Vals AI–89.7%
CritPtArtificial Analysis24.6%11.3%
Coding
SciCodeSciCode–51.5%
Arena CodingArena (LMArena)–1529
LiveBench 2.0 CodingLiveBench81.8%–
SciCode (AA)Artificial Analysis60.8%–
SWE-bench (Vals)Vals AI–74.4%
SWE-Bench ProScale AI SEAL–55.0%
Vibe Code Bench v1.1Vals AI–19.7%
SWE-Bench Pro (private)Scale AI SEAL–55.0%
SWE Atlas: Codebase QnAScale AI SEAL–24.2%
SWE Atlas: Test WritingScale AI SEAL–31.1%
Terminal-Bench 4.0 (AA)Artificial Analysis67.2%–
Terminal-Bench 2.1 (AA)Artificial Analysis–62.2%
FrontierCode 1.1 (AA)Artificial Analysis47.1%–
Agents & tools
LiveBench Long AgenticLiveBench49.5%–
LiveBench BrowserLiveBench80.0%–
Terminal-Bench HardArtificial Analysis–45.5%
τ²-Bench Telecom (AA)Artificial Analysis–91.5%
Show all 73 benchmarks
MetricPublisherKimi K3.1 ProMuse Spark
Agents & tools
MCP AtlasScale AI SEAL–82.2%
GDPval-AA v2.1Artificial Analysis67.3%–
Terminal-Bench 2.0 (Vals)Vals AI–59.5%
AutomationBenchArtificial Analysis73.3%–
GDP.pdf (AA)Artificial Analysis31.4%–
AA-Briefcase v1.1Artificial Analysis1678–
CWE-Bench (AA)Artificial Analysis60.8%–
DeepSec-Bench (AA)Artificial Analysis36.7%–
CyberGym end-to-end (AA)Artificial Analysis94.7%–
Maths
OTIS Mock AIMEEpoch AI Benchmarking Hub–88.9%
ProofBenchVals AI–17.0%
AIME (Vals)Vals AI–96.9%
Arena MathsArena (LMArena)–1467
Knowledge
LiveBench 2.0 Data AnalysisLiveBench79.1%–
LiveBench ResearchLiveBench77.9%–
AA-OmniscienceArtificial Analysis29.57.2
MMLU-ProVals AI–87.3%
LegalBenchVals AI–84.2%
CorpFinVals AI–65.1%
TaxEvalVals AI–77.7%
PRBench FinanceScale AI SEAL–52.4%
PRBench LegalScale AI SEAL–52.3%
MultiNRCScale AI SEAL–59.0%
CaseLaw v2Vals AI–63.1%
MedCodeVals AI–51.3%
MedScribeVals AI–85.9%
AA-Omniscience: accuracyArtificial Analysis51.0%49.6%
AA-Omniscience: non-hallucinationArtificial Analysis56.1%15.8%
Instruction following
IFBenchArtificial Analysis–75.9%
MultiChallengeScale AI SEAL–75.5%
TutorBenchScale AI SEAL–68.5%
Arena Instruction FollowingArena (LMArena)–1465
Human preference
Arena TextArena (LMArena)–1489
Arena Creative WritingArena (LMArena)–1464
Arena Multi-turnArena (LMArena)–1494
Arena Longer QueriesArena (LMArena)–1476
Multimodal
Arena VisionArena (LMArena)–1306
LiveBench DesignLiveBench77.8%–
MMMU-ProArtificial Analysis83.9%80.5%
MMMU-Pro (official)MMMU–80.4%†
MMMU-Pro (Vals)Vals AI–87.4%
Long context
AA-LCRArtificial Analysis86.3%78.0%
Arena DocumentArena (LMArena)–1467
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub–152.0
LiveBench 2.0LiveBench76.7%–
AA Intelligence Index v4.3.2Artificial Analysis55.131.3
AA Cyber IndexArtificial Analysis64.1–
Safety & honesty
FORTRESSScale AI SEAL–20.2%

Data as of 2026-10-24. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Kimi K3.1 Pro: BenchLeader Index 65.6 → 66.8.
  • Kimi K3.1 Pro: 5 new results (FrontierCode 1.1 (AA), AA Cyber Index, CWE-Bench (AA)…).
  • Kimi K3.1 Pro: first results.
  • Muse Spark: 1 new result (PRBench Legal).
  • Muse Spark: 1 new result (SWE Atlas: Codebase QnA).
  • Muse Spark: 2 new results (PRBench Legal, MultiNRC).
  • Muse Spark: 1 new result (PRBench Finance).
  • Muse Spark: 1 new result (PRBench Finance).
  • Muse Spark: 1 new result (TutorBench); 1 score revision.
  • Muse Spark: BenchLeader Index 64.9 → 64.4.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Kimi K3.1 Pro vs Muse Spark: questions

Is Kimi K3.1 Pro better than Muse Spark?
Kimi K3.1 Pro and Muse Spark are neck and neck on quality (66.8 vs 64.3, within the ±6.9 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 2026-10-24, so check the category scores for your use.
Is Kimi K3.1 Pro better than Muse Spark for agents and tool use?
Kimi K3.1 Pro scores higher in agentic tasks (67 vs 66 on the category index, where 50 is average).
Which is better for long documents?
Kimi K3.1 Pro scores higher on long-context benchmarks (68 vs 64). Kimi K3.1 Pro accepts more context: 1,048,576 against 262,144 tokens for Muse Spark.
Do independent benchmarks agree on Kimi K3.1 Pro vs Muse Spark?
Across the 7 benchmarks both have, Kimi K3.1 Pro leads 7, Muse Spark leads 0. Every overall index that rates both puts Kimi K3.1 Pro ahead.
When was Kimi K3.1 Pro released?
Kimi K3.1 Pro was released on 23 Oct 2026.