BenchLeader

GPT-5.1 vs Muse Spark

Verdict
  • Muse Spark leads on quality: 65.6 vs 59.6.
  • GPT-5.1 is stronger in knowledge, long context.
  • Muse Spark is stronger in agents & tools, coding, composite, human preference, instruction following, multimodal, reasoning, maths.
MetricGPT-5.1Muse Spark
BenchLeader Index59.665.6
Agents & tools score55.766.4
Coding score47.166.2
Composite score60.368.6
Human preference score63.369.3
Instruction following score71.079.7
Knowledge score66.764.6
Long context score66.665.5
Multimodal score61.865.9
Reasoning score58.770.2
Maths score56.4
Blended price $/M$3.44
Output speed91 tok/s
Time to first answer43.1 s
Context window400k262k
GPQA Diamond89.8%
OTIS Mock AIME88.9%
Humanity's Last Exam23.7%40.6%
Terminal-Bench47.6%
SciCode43.3%51.5%
APEX-Agents17.5%
ProofBench17.0%
GSO-Bench13.7%
Epoch Capabilities Index149.7152.1
LMArena Text14391488
LMArena Hard Prompts14561505
LMArena Coding14751526
LMArena WebDev1341
LMArena Vision12351306
AA Intelligence Index24.731.3
IFBench72.9%75.9%
AA-LCR80.0%78.0%
MMMU-Pro75.5%80.5%
AA-Omniscience5.47.2
Terminal-Bench Hard45.5%45.5%
GPQA Diamond (AA)87.3%88.4%
Humanity's Last Exam (AA)28.5%40.7%
τ²-Bench Telecom (AA)81.9%91.5%
AIME (Vals)96.9%
MMLU-Pro87.3%
LegalBench84.2%
CorpFin65.1%
TaxEval77.7%
SWE-bench (Vals)74.4%
GPQA Diamond (Vals)89.7%
SWE-Bench Pro55.0%
MCP Atlas82.2%
MultiChallenge75.5%
PRBench Finance52.4%
PRBench Legal52.3%
MultiNRC59.0%
TutorBench68.5%
MMMU (validation)85.4%
MMMU-Pro (official)76.0%

Data as of 2026-09-10. Best configuration of each model; every score links to its source on the model pages.

GPT-5.1 vs Muse Spark: questions

Is GPT-5.1 better than Muse Spark?
Muse Spark leads on quality: 65.6 vs 59.6. The BenchLeader Index combines every independent quality benchmark; Muse Spark is ahead overall as of 2026-09-10, but check the category scores for your use.
Is GPT-5.1 better than Muse Spark for coding?
Muse Spark scores higher in coding (66 vs 47 on the category index, where 50 is average).
Is GPT-5.1 better than Muse Spark for agentic tasks?
Muse Spark scores higher in agentic tasks (66 vs 56 on the category index, where 50 is average).
Which has the larger context window?
GPT-5.1 accepts more context: 400k against 262k tokens.