BenchLeader

Muse Spark vs Muse Spark 1.1

Full profiles: Muse Spark (Meta) and Muse Spark 1.1 (Meta): every benchmark, price and rank.

Updated · Data from 8 sources

As of 25 Oct 2026, Muse Spark and Muse Spark 1.1 are neck and neck on quality (64.3 vs 62.5, inside the ±6.4 margin of error) and close on price, so pick on the category that matters to you. Pick Muse Spark for agents & tools (66 vs 52); pick Muse Spark 1.1 for knowledge (69 vs 63).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingMuse Spark 1.166 vs 65 category score; SWE-Bench Pro 61.5% vs 55.0%Medium
Agents & tool useMuse Spark66 vs 52 category score; MCP Atlas 82.2% vs 88.1%High
MathsMuse Spark 1.161 vs 59 category score; Arena Maths 1493 vs 1467Medium
ReasoningMuse Spark 1.168 vs 65 category score; Arena Hard Prompts 1510 vs 1506Medium
KnowledgeMuse Spark 1.169 vs 63 category score; PRBench Finance 55.0% vs 52.4%Medium
Images and other mediaEither65 vs 64 category score; Arena Vision 1306 vs 1293Either
Following instructionsMuse Spark77 vs 72 category score; MultiChallenge 75.5% vs 75.3%Medium
Chat quality (human preference)Muse Spark68 vs 65 on Arena votesMedium
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Muse Spark and Muse Spark 1.1 are neck and neck on quality (64.3 vs 62.5, within the ±6.4 margin).
  • Muse Spark is stronger in agents & tools, composite, human preference, instruction following, long context, multimodal.
  • Muse Spark 1.1 is stronger in coding, knowledge, maths, reasoning.

At a glance

SpecMuse SparkMuse Spark 1.1
DeveloperMetaMeta
Released8 Apr 20269 Jul 2026
Context window (tokens)262,1441,048,576
Compared atMuse SparkMuse Spark 1.1
Open weightsNoNo
Price in / out / cached input per 1M–$1.25 / $4.25 / $0.150

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryMuse SparkMuse Spark 1.1Leader
Reasoning65.367.9Muse Spark 1.1
Coding65.066.3Muse Spark 1.1
Agents & tools66.151.8Muse Spark
Maths59.161.3Muse Spark 1.1
Knowledge63.369.2Muse Spark 1.1
Instruction following77.371.5Muse Spark
Human preference68.365.0Muse Spark
Multimodal64.563.6level
Long context64.0–not comparable
Composite64.5–not comparable

Where sources disagree

Across the 20 benchmarks both have, Muse Spark leads 4, Muse Spark 1.1 leads 16. Every overall index that rates both puts Muse Spark 1.1 ahead.

Overall indexMuse SparkMuse Spark 1.1Leader
BenchLeader Index64.362.5neck and neck
AA Intelligence Index v4.3.231.333.7†Muse Spark 1.1
Arena Text14891490Muse Spark 1.1

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureMuse SparkMuse Spark 1.1
Blended price per 1M tokens–$2.00
Input / output per 1M– / –$1.25 / $4.25
Cached input per 1M–$0.150
Price per task: chat reply–$0.0018
Price per task: summarize a 30-page report–$0.018
Price per task: code edit–$0.014
Price per task: agentic coding session–$0.092
Price per task: structured extraction–$0.0034
Output speed–200 tok/s
Time to first answer–1.5 s

Each model is compared at its best-ranked reasoning-effort setting. Muse Spark scores 64.3. Muse Spark 1.1 scores 62.5 and takes 2 s to its first answer token; Muse Spark 1.1 (xhigh) scores 61.6 in 18 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

97 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherMuse SparkMuse Spark 1.1
BenchLeader IndexBenchLeader64.362.5
Agents & tools scoreBenchLeader66.151.8
Coding scoreBenchLeader65.066.3
Composite scoreBenchLeader64.5–
Human preference scoreBenchLeader68.365.0
Instruction following scoreBenchLeader77.371.5
Knowledge scoreBenchLeader63.369.2
Long context scoreBenchLeader64.0–
Maths scoreBenchLeader59.161.3
Multimodal scoreBenchLeader64.563.6
Reasoning scoreBenchLeader65.367.9
Blended price $/MBenchLeader–$2.00
Output speedBenchLeader–200 tok/s
Time to first answerBenchLeader–1.5 s
Context windowBenchLeader262,144 tokens1,048,576 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub89.8%–
Humanity's Last ExamScale AI / CAIS40.6%–
Arena Hard PromptsArena (LMArena)15061510
LiveBench 1.0 ReasoningLiveBench–87.7%†
GPQA Diamond (AA)Artificial Analysis88.4%89.8%†
Humanity's Last Exam (AA)Artificial Analysis40.7%46.2%†
GPQA Diamond (Vals)Vals AI89.7%91.2%†
CritPtArtificial Analysis11.3%15.1%†
Chess PuzzlesEpoch AI Benchmarking Hub–34.0%†
LMCAEpoch AI Benchmarking Hub–49.9%†
DTBenchEpoch AI Benchmarking Hub–94.4%†
Coding
SciCodeSciCode51.5%58.8%
Arena CodingArena (LMArena)15291533
Arena WebDevArena (LMArena)–1543
LiveBench 1.0 CodingLiveBench–77.2%†
SciCode (AA)Artificial Analysis–58.8%†
LiveCodeBenchVals AI–85.9%†
SWE-bench (Vals)Vals AI74.4%82.0%†
SWE-Bench ProScale AI SEAL55.0%61.5%
Code MigrationVals AI–31.1%†
ProgramBenchVals AI–0.0%†
Vibe Code Bench v1.1Vals AI19.7%72.2%†
SWE-Bench Pro (private)Scale AI SEAL55.0%61.5%
SWE Atlas: Codebase QnAScale AI SEAL24.2%42.2%†
SWE Atlas: Test WritingScale AI SEAL31.1%41.5%†
Show all 97 benchmarks
MetricPublisherMuse SparkMuse Spark 1.1
Coding
Surface Evolver BenchEpoch AI Benchmarking Hub–52.5%†
DeepSWE v1.1Epoch AI Benchmarking Hub–53.3%
Terminal-Bench 4.0 (AA)Artificial Analysis–6.1%†
Terminal-Bench 2.1 (AA)Artificial Analysis62.2%77.9%†
Agents & tools
APEX-AgentsMercor–31.8%
Arena AgentArena (LMArena)–-6.9
LiveBench Agentic CodingLiveBench–58.5%†
Terminal-Bench HardArtificial Analysis45.5%–
τ²-Bench Telecom (AA)Artificial Analysis91.5%–
Terminal-Bench 2.1 (Vals)Vals AI–69.3%†
MCP AtlasScale AI SEAL82.2%88.1%
τ³-bench Bankingτ²-bench–40.5%†
τ³-Banking (AA)Artificial Analysis–31.8%†
Finance Agent v2Vals AI–57.2%†
Harvey's Legal Agent Benchmark v1Vals AI–20.0%†
Legal Research BenchVals AI–38.0%†
SkillsBenchVals AI–59.2%†
Terminal-Bench 2.0 (Vals)Vals AI59.5%–
Time Horizon Index: KSPVals AI–1.7%†
GBAEvalEpoch AI Benchmarking Hub–7.9%
Vending-Bench 2Andon Labs–6520.5
AutomationBenchArtificial Analysis–38.9%†
GDP.pdf (AA)Artificial Analysis–14.4%†
Maths
OTIS Mock AIMEEpoch AI Benchmarking Hub88.9%–
ProofBenchVals AI17.0%39.0%
LiveBench MathematicsLiveBench–87.1%†
AIME (Vals)Vals AI96.9%–
Arena MathsArena (LMArena)14671493
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub–57.8%
LiveBench 1.0 Data AnalysisLiveBench–72.5%†
AA-OmniscienceArtificial Analysis7.228.1†
MMLU-ProVals AI87.3%88.7%†
LegalBenchVals AI84.2%85.0%†
CorpFinVals AI65.1%71.3%†
TaxEvalVals AI77.7%79.7%†
PRBench FinanceScale AI SEAL52.4%55.0%
PRBench LegalScale AI SEAL52.3%57.0%
MultiNRCScale AI SEAL59.0%65.6%
CaseLaw v2Vals AI63.1%–
Excel Modeling BenchmarkVals AI–56.4%†
MedCodeVals AI51.3%–
MedScribeVals AI85.9%88.9%†
Public Benefits Bench v1.1Vals AI–61.3%†
GDP.pdfEpoch AI Benchmarking Hub–15.0%
AA-Omniscience: accuracyArtificial Analysis49.6%52.0%†
AA-Omniscience: non-hallucinationArtificial Analysis15.8%50.0%†
Instruction following
LiveBench LanguageLiveBench–74.3%†
LiveBench Instruction FollowingLiveBench–69.6%†
IFBenchArtificial Analysis75.9%–
MultiChallengeScale AI SEAL75.5%75.3%
TutorBenchScale AI SEAL68.5%–
Arena Instruction FollowingArena (LMArena)14651472
Human preference
Arena TextArena (LMArena)14891490
EQ-Bench 4EQ-Bench–1252
Arena Creative WritingArena (LMArena)14641443
Arena Multi-turnArena (LMArena)14941496
Arena Longer QueriesArena (LMArena)14761480
Multimodal
Arena VisionArena (LMArena)13061293
MMMU-ProArtificial Analysis80.5%–
MMMU-Pro (official)MMMU80.4%†–
MMMU-Pro (Vals)Vals AI87.4%86.6%†
MortgageTaxVals AI–66.1%†
SAGEVals AI–45.6%†
VTBScale AI SEAL–44.8%
Long context
AA-LCRArtificial Analysis78.0%77.7%†
Arena DocumentArena (LMArena)14671480
MLCRArtificial Analysis–7.2%†
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub152.0154.1
LiveBench 1.0LiveBench–75.3%†
AA Intelligence Index v4.3.2Artificial Analysis31.333.7†
Vals Multimodal IndexVals AI–66.7%†
Safety & honesty
FORTRESSScale AI SEAL20.2%12.4%

Data as of 2026-10-25. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Muse Spark 1.1: 1 score revision.
  • Muse Spark 1.1: BenchLeader Index 63.1 → 62.5.
  • Muse Spark 1.1: 1 score revision.
  • Muse Spark: 1 new result (PRBench Legal).
  • Muse Spark 1.1: 1 new result (PRBench Legal).
  • Muse Spark: 1 new result (SWE Atlas: Codebase QnA).
  • Muse Spark 1.1: 1 new result (VTB).
  • Muse Spark 1.1: BenchLeader Index 62.5 → 63.1.
  • Muse Spark: 2 new results (PRBench Legal, MultiNRC).
  • Muse Spark 1.1: 2 new results (PRBench Legal, MultiNRC).

Rankings: Best LLM overall · Best LLM for coding · Best LLM for agents · Best cheap LLMs

Muse Spark vs Muse Spark 1.1: questions

Is Muse Spark better than Muse Spark 1.1?
Muse Spark and Muse Spark 1.1 are neck and neck on quality (64.3 vs 62.5, within the ±6.4 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 2026-10-25, so check the category scores for your use.
Is Muse Spark better than Muse Spark 1.1 for coding?
Muse Spark 1.1 scores higher in coding (66 vs 65 on the category index, where 50 is average). On SWE-Bench Pro, the top shared coding benchmark, it is 55.0% for Muse Spark against 61.5% for Muse Spark 1.1.
Is Muse Spark better than Muse Spark 1.1 for agents and tool use?
Muse Spark scores higher in agentic tasks (66 vs 52 on the category index, where 50 is average). On MCP Atlas, the top shared agents & tools benchmark, it is 82.2% for Muse Spark against 88.1% for Muse Spark 1.1.
Which is better for long documents?
Muse Spark 1.1 accepts more context: 1,048,576 against 262,144 tokens for Muse Spark.
Do independent benchmarks agree on Muse Spark vs Muse Spark 1.1?
Across the 20 benchmarks both have, Muse Spark leads 4, Muse Spark 1.1 leads 16. Every overall index that rates both puts Muse Spark 1.1 ahead.
When was Muse Spark 1.1 released?
Muse Spark 1.1 was released on 9 Jul 2026.