BenchLeader

Muse Spark vs Muse Spark 1.1

Verdict
  • Muse Spark and Muse Spark 1.1 are level on quality (65.4 vs 64.9).
  • Muse Spark is stronger in agents & tools, human preference, instruction following, long context, maths, multimodal, reasoning.
  • Muse Spark 1.1 is stronger in coding, composite, knowledge.
MetricMuse SparkMuse Spark 1.1
BenchLeader Index65.464.9
Agents & tools score66.362.7
Coding score66.068.2
Composite score68.472.2
Human preference score69.066.0
Instruction following score79.677.8
Knowledge score64.573.1
Long context score65.565.3
Maths score56.352.2
Multimodal score65.964.9
Reasoning score70.068.8
Blended price $/M$2.00
Output speed194 tok/s
Time to first answer2.0 s
Context window262k1.0M
GPQA Diamond89.8%
OTIS Mock AIME88.9%
SimpleQA Verified57.8%
Humanity's Last Exam40.6%
SciCode51.5%58.2%
APEX-Agents41.9%
ProofBench17.0%39.0%
Epoch Capabilities Index152.1154.6
LMArena Text14881492
LMArena Hard Prompts15051511
LMArena Coding15261531
LMArena WebDev1541
LMArena Vision13061293
LMArena Agent-2.6
AA Intelligence Index31.334.3
IFBench75.9%
AA-LCR78.0%77.7%
MMMU-Pro80.5%
AA-Omniscience7.228.1
Terminal-Bench Hard45.5%
GPQA Diamond (AA)88.4%89.8%
Humanity's Last Exam (AA)40.7%46.2%
SciCode (AA)58.8%
τ²-Bench Telecom (AA)91.5%
AIME (Vals)96.9%
MMLU-Pro87.3%
LegalBench84.2%
CorpFin65.1%
TaxEval77.7%
SWE-bench (Vals)74.4%
GPQA Diamond (Vals)89.7%
SWE-Bench Pro55.0%61.5%
MCP Atlas82.2%88.1%
MultiChallenge75.5%75.3%
PRBench Finance52.4%55.0%
PRBench Legal52.3%57.0%
MultiNRC59.0%65.6%
TutorBench68.5%
EQ-Bench 41260

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.