BenchLeader

Muse Spark vs Qwen3 8

Verdict
  • Muse Spark leads on quality: 65.4 vs 63.9.
  • Muse Spark is stronger in agents & tools, human preference, instruction following, knowledge, maths, reasoning.
  • Qwen3 8 (max) is stronger in coding, composite, long context, multimodal.
MetricMuse SparkQwen3 8 (max)
BenchLeader Index65.463.9
Agents & tools score66.356.1
Coding score66.071.7
Composite score68.470.8
Human preference score69.067.9
Instruction following score79.6
Knowledge score64.562.3
Long context score65.565.7
Maths score56.3
Multimodal score65.967.2
Reasoning score70.067.7
Blended price $/M$2.67
Output speed39 tok/s
Time to first answer53.2 s
Context window262k1M
GPQA Diamond89.8%
OTIS Mock AIME88.9%
Humanity's Last Exam40.6%
SciCode51.5%
ProofBench17.0%
Epoch Capabilities Index152.1156.6
LMArena Text14881480
LMArena Hard Prompts15051502
LMArena Coding15261520
LMArena WebDev1685
LMArena Vision13061313
LMArena Agent3.9
LiveBench78.5%
LiveBench Reasoning88.2%
LiveBench Coding72.9%
LiveBench Agentic Coding64.7%
LiveBench Mathematics91.3%
LiveBench Data Analysis78.4%
LiveBench Language79.7%
AA Intelligence Index31.340.3
IFBench75.9%
AA-LCR78.0%78.3%
MMMU-Pro80.5%82.3%
AA-Omniscience7.23.4
Terminal-Bench Hard45.5%
GPQA Diamond (AA)88.4%92.7%
Humanity's Last Exam (AA)40.7%43.0%
SciCode (AA)53.2%
τ²-Bench Telecom (AA)91.5%
AIME (Vals)96.9%
LiveCodeBench87.8%
MMLU-Pro87.3%88.6%
IOI73.0%
LegalBench84.2%83.6%
CorpFin65.1%65.8%
TaxEval77.7%75.5%
Terminal-Bench 2.1 (Vals)67.4%
SWE-bench (Vals)74.4%85.6%
GPQA Diamond (Vals)89.7%93.7%
Vals Index51.8
SWE-Bench Pro55.0%
MCP Atlas82.2%
MultiChallenge75.5%
PRBench Finance52.4%
PRBench Legal52.3%
MultiNRC59.0%
TutorBench68.5%

Data as of 2026-09-09. Best configuration of each model; every score links to its source on the model pages.