BenchLeader

Muse Spark 1.1 vs Qwen3 8

Verdict
  • Muse Spark 1.1 leads on quality: 64.9 vs 63.9.
  • Muse Spark 1.1 is stronger in agents & tools, composite, instruction following, knowledge, maths, reasoning.
  • Qwen3 8 (max) is stronger in coding, human preference, long context, multimodal.
  • Muse Spark 1.1 is 1.3× cheaper ($2.00 vs $2.67 per 1M blended).
  • Muse Spark 1.1 streams 4.9× faster (194 vs 39 tokens per second).
MetricMuse Spark 1.1Qwen3 8 (max)
BenchLeader Index64.963.9
Agents & tools score62.756.1
Coding score68.271.7
Composite score72.270.8
Human preference score66.067.9
Instruction following score77.8
Knowledge score73.162.3
Long context score65.365.7
Maths score52.2
Multimodal score64.967.2
Reasoning score68.867.7
Blended price $/M$2.00$2.67
Output speed194 tok/s39 tok/s
Time to first answer2.0 s53.2 s
Context window1.0M1M
SimpleQA Verified57.8%
SciCode58.2%
APEX-Agents41.9%
ProofBench39.0%
Epoch Capabilities Index154.6156.6
LMArena Text14921480
LMArena Hard Prompts15111502
LMArena Coding15311520
LMArena WebDev15411685
LMArena Vision12931313
LMArena Agent-2.63.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index34.340.3
AA-LCR77.7%78.3%
MMMU-Pro82.3%
AA-Omniscience28.13.4
GPQA Diamond (AA)89.8%92.7%
Humanity's Last Exam (AA)46.2%43.0%
SciCode (AA)58.8%53.2%
LiveCodeBench87.8%
MMLU-Pro88.6%
IOI73.0%
LegalBench83.6%
CorpFin65.8%
TaxEval75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)85.6%
GPQA Diamond (Vals)93.7%
Vals Index51.8
SWE-Bench Pro61.5%
MCP Atlas88.1%
MultiChallenge75.3%
PRBench Finance55.0%
PRBench Legal57.0%
MultiNRC65.6%
EQ-Bench 41260

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.