BenchLeader

Claude Sonnet 5.5 vs Muse Spark Open 816B A42B

Full profiles: Claude Sonnet 5.5 (Anthropic) and Muse Spark Open 816B A42B (Meta): every benchmark, price and rank.

Updated · Data from 11 sources

As of 16 Nov 2026, Claude Sonnet 5.5 is ahead of Muse Spark Open 816B A42B on quality (64.2 vs 58.1 on the BenchLeader Index), but Muse Spark Open 816B A42B is 2.0× cheaper at $2.00 vs $4.00 per 1M tokens blended. Choose Claude Sonnet 5.5 for maths (71 vs 59), coding (70 vs 65), and reasoning (68 vs 63); choose Muse Spark Open 816B A42B for knowledge (62 vs 57).

Key facts (as of 16 Nov 2026)

  • Claude Sonnet 5.5 scores 64.2 on the BenchLeader Index and Muse Spark Open 816B A42B scores 58.1 (BenchLeader, 16 Nov 2026).
  • Claude Sonnet 5.5 costs $4.00 per 1M tokens blended (list price, 16 Nov 2026).
  • Muse Spark Open 816B A42B costs $2.00 per 1M tokens blended (list price, 16 Nov 2026).
  • Of the 6 benchmarks both models have, Claude Sonnet 5.5 leads 5 (BenchLeader, 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingClaude Sonnet 5.570 vs 65 category score; SciCode 61.0% vs 58.5%Medium
MathsClaude Sonnet 5.571 vs 59 category score; FrontierMath Tiers 1–3 88.8% vs 69.8%High
ReasoningClaude Sonnet 5.568 vs 63 category score; GPQA Diamond 95.6% vs 88.6%Medium
KnowledgeMuse Spark Open 816B A42B62 vs 57 category score; SimpleQA Verified 56.6% vs 46.5%Medium
Lowest costMuse Spark Open 816B A42B$2.00 vs $4.00 per 1M blended; agentic coding session $0.092 vs $0.160–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Claude Sonnet 5.5 (max) leads on quality: 64.2 vs 58.1.
  • Claude Sonnet 5.5 (max) is stronger in coding, maths, reasoning.
  • Muse Spark Open 816B A42B (xhigh) is stronger in knowledge.
  • Muse Spark Open 816B A42B (xhigh) is 2.0× cheaper ($2.00 vs $4.00 per 1M blended).

At a glance

SpecClaude Sonnet 5.5Muse Spark Open 816B A42B
DeveloperAnthropicMeta
Released28 Sep 202615 Oct 2026
Context window (tokens)1,000,0001,048,576
Compared atClaude Sonnet 5.5 (max)Muse Spark Open 816B A42B (xhigh)
Open weightsNoYes
Price in / out / cached input per 1M$2.00 / $10.00 / $0.100$1.25 / $4.25 / $0.150

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryClaude Sonnet 5.5 (max)Muse Spark Open 816B A42B (xhigh)Leader
Reasoning67.863.2Claude Sonnet 5.5
Coding70.265.1Claude Sonnet 5.5
Agents & tools70.5–not comparable
Maths71.358.7Claude Sonnet 5.5
Knowledge57.461.5Muse Spark Open 816B A42B
Long context66.0–not comparable
Composite63.0–not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingMathsKnowledgeClaude Sonnet 5.5, Reasoning: 67.8Claude Sonnet 5.5, Coding: 70.2Claude Sonnet 5.5, Maths: 71.3Claude Sonnet 5.5, Knowledge: 57.4Muse Spark Open 816B A42B, Reasoning: 63.2Muse Spark Open 816B A42B, Coding: 65.1Muse Spark Open 816B A42B, Maths: 58.7Muse Spark Open 816B A42B, Knowledge: 61.5

Not drawn, measured for fewer than two of these models: Agents & tools, Instruction following, Long context, Multimodal, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 6 benchmarks both have, Claude Sonnet 5.5 leads 5, Muse Spark Open 816B A42B leads 1. Every overall index that rates both puts Claude Sonnet 5.5 ahead.

Overall indexClaude Sonnet 5.5 (max)Muse Spark Open 816B A42B (xhigh)Leader
BenchLeader Index64.258.1Claude Sonnet 5.5

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureClaude Sonnet 5.5 (max)Muse Spark Open 816B A42B (xhigh)
Blended price per 1M tokens$4.00$2.00
Input / output per 1M$2.00 / $10.00$1.25 / $4.25
Cached input per 1M$0.100$0.150
Price per task: chat reply$0.0038$0.0018
Price per task: summarize a 30-page report$0.030$0.018
Price per task: code edit$0.027$0.014
Price per task: agentic coding session$0.160$0.092
Price per task: structured extraction$0.0060$0.0034
Agentic coding session, input mostly cached$0.074$0.043
Cost per benchmark task (AA Index)$10.02–
Output tokens per task (AA Index)285k–
Of which reasoning206k–
Time per task (AA Index)31 min–
Output speed152 tok/s–
Time to first answer290.5 s–
Time to a complete answer, last measured 13 Nov 2026487.7 s–

Each model is compared at its best-ranked reasoning-effort setting. Claude Sonnet 5.5 (max) scores 64.2 and takes 291 s to its first answer token; Claude Sonnet 5.5 (xhigh) scores 62.5 in 27 s, Claude Sonnet 5.5 (high) scores 59.5 in 9 s. Muse Spark Open 816B A42B (xhigh) scores 58.1. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

141 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherClaude Sonnet 5.5 (max)Muse Spark Open 816B A42B (xhigh)
BenchLeader IndexBenchLeader64.258.1
Agents & tools scoreBenchLeader70.5–
Coding scoreBenchLeader70.265.1
Composite scoreBenchLeader63.0–
Knowledge scoreBenchLeader57.461.5
Long context scoreBenchLeader66.0–
Maths scoreBenchLeader71.358.7
Reasoning scoreBenchLeader67.863.2
Blended price $/MBenchLeader$4.00$2.00
Output speedBenchLeader152 tok/s–
Time to first answerBenchLeader290.5 s–
Context windowBenchLeader1,000,000 tokens1,048,576 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub95.6%88.6%
Humanity's Last ExamScale AI / CAIS46.1%†–
SimpleBenchSimpleBench75.9%†–
Arena Hard PromptsArena (LMArena)1499†–
LiveBench 2.0 ReasoningLiveBench91.6%–
LiveBench 1.0 ReasoningLiveBench91.6%–
Humanity's Last Exam (AA)Artificial Analysis55.0%–
HLE-Diamond (AA)Artificial Analysis53.3%–
ARC-AGI-1ARC Prize96.5%–
ARC-AGI-2ARC Prize83.9%†–
ARC-AGI-3ARC Prize72.4%†–
CritPtArtificial Analysis31.4%–
CritPt v2 hard subset (AA)Artificial Analysis59.0%–
MysteryMechanismVals AI49.1%–
HLE-Diamond (Scale)Scale AI SEAL37.5%†–
Arena ExpertArena (LMArena)1512†–
Chess PuzzlesEpoch AI Benchmarking Hub59.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub65.0%–
LMCAEpoch AI Benchmarking Hub68.3%–
DTBenchEpoch AI Benchmarking Hub97.3%–
Coding
SciCodeSciCode61.0%58.5%
FrontierCodeCognition52.1%†–
Arena CodingArena (LMArena)1517†–
Arena WebDevArena (LMArena)1772†–
LiveBench 2.0 CodingLiveBench77.2%–
Show all 141 benchmarks
MetricPublisherClaude Sonnet 5.5 (max)Muse Spark Open 816B A42B (xhigh)
Coding
LiveBench 1.0 CodingLiveBench91.4%–
SciCode (AA)Artificial Analysis61.0%–
IOIVals AI83.1%–
Code MigrationVals AI69.8%–
Code Migration v1.1Vals AI86.9%–
ProgramBenchVals AI6.5%–
SWE-bench MultimodalVals AI58.3%–
Vibe Code Bench v1.1Vals AI92.4%–
SWE Atlas v1.1Scale AI SEAL68.3%†–
SWE Atlas v1.1: Codebase QnAScale AI SEAL74.2%†–
SWE Atlas v1.1: Test WritingScale AI SEAL67.8%†–
SWE Atlas v1.1: RefactoringScale AI SEAL62.9%†–
SWE-Bench Pro V2Scale AI SEAL95.8%†–
SWE-Bench Pro V2 HARDScale AI SEAL70.6%†–
MirrorCodeEpoch AI Benchmarking Hub97.8%–
CursorBenchCursor55.5%–
ALE-BenchEpoch AI Benchmarking Hub1819.1†1590.1
FrontierSWEEpoch AI Benchmarking Hub61.9%–
WeirdML v3WeirdML19.9%†–
Terminal-Bench 4.0 (AA)Artificial Analysis63.6%–
Startrise FrontendStartrise75.9%†–
GameBench 2 OverallDuelLab GameBench 260.4†–
GameBench 2 by reasoning settingDuelLab GameBench 291.4†–
Design Arena WebsiteDesign Arena1309†–
FrontierCode 1.1 (AA)Artificial Analysis45.8%–
FrontierCode 2.0 (AA)Artificial Analysis41.7%–
Agents & tools
Terminal-BenchTerminal-Bench63.9%–
APEX-AgentsMercor75.5%33.4%†
Arena AgentArena (LMArena)16–
LiveBench Long AgenticLiveBench63.4%–
LiveBench BrowserLiveBench89.3%–
LiveBench Agentic CodingLiveBench56.3%–
Terminal-Bench 2.1 (Vals)Vals AI83.2%†–
GDPval-AA v2.1, normalised scoreArtificial Analysis66.9%–
GDPval-AA v2.1Artificial Analysis1838–
Analyst Agent (AA)Artificial Analysis57.5%–
CyberBenchVals AI59.6%–
Finance Agent v2Vals AI58.1%–
Finance Agent v2.1Vals AI67.3%–
Harvey's Legal Agent Benchmark v1.1Vals AI10.4%–
Harvey's Legal Agent Benchmark v1Vals AI2.9%–
Legal Research BenchVals AI48.1%–
SREBenchVals AI30.1%–
Tax Agent BenchVals AI42.0%–
Terminal-Bench 4.0 (Vals)Vals AI64.1%–
Terminal-Bench ScienceVals AI47.1%–
Arena Agent Task CompletionArena (LMArena)19.5–
Vending-Bench 2Andon Labs11165.3†–
SpireClimbEpoch AI Benchmarking Hub1.3%–
AutomationBenchArtificial Analysis71.8%–
GDP.pdf (AA)Artificial Analysis25.8%–
Harvey LAB-AA v1.1Harvey2.8%–
AA-Briefcase v1.1Artificial Analysis1816–
GDPxGDPx by SemiAnalysis8.2%–
Design Arena AgenticDesign Arena1293†–
Terminal-Bench-Science 0.1 (AA)Artificial Analysis53.3%–
MKA (AA)Artificial Analysis52.0%–
FACTS SearchGoogle86.8%†–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub88.8%69.8%
FrontierMath Tier 4Epoch AI Benchmarking Hub80.5%31.7%
OTIS Mock AIMEEpoch AI Benchmarking Hub100.0%98.1%
ProofBenchVals AI100.0%–
LiveBench MathematicsLiveBench96.1%–
Arena MathsArena (LMArena)1486†–
FrontierMath ErdősEpoch AI Benchmarking Hub2.9%–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub46.5%56.6%
LiveBench 2.0 Data AnalysisLiveBench59.5%–
LiveBench ResearchLiveBench88.0%–
LiveBench 1.0 Data AnalysisLiveBench59.5%–
AA-Omniscience v1.1Artificial Analysis30.5–
BioMysteryBenchVals AI81.1%–
ClaimBenchVals AI100.0%–
Excel Modeling BenchmarkVals AI75.7%–
Excel Modeling Benchmark v1.1Vals AI75.9%–
MedCodeVals AI52.9%–
MedScribeVals AI91.1%–
Public Benefits Bench v1.1Vals AI67.2%–
Access to Justice BenchmarkVals AI74.9%–
Financial Coaching BenchVals AI74.9%–
Immigration BenchVals AI69.0%–
GDP.pdfEpoch AI Benchmarking Hub31.4%–
AA-Omniscience v1.1: accuracyArtificial Analysis51.5%–
AA-Omniscience v1.1: non-hallucinationArtificial Analysis56.7%–
HealthBench Professional (AA)OpenAI63.0%–
FACTS ParametricGoogle35.1%†–
Instruction following
LiveBench LanguageLiveBench78.0%–
LiveBench Instruction FollowingLiveBench56.8%–
Arena Instruction FollowingArena (LMArena)1482†–
Human preference
Arena TextArena (LMArena)1473†–
Arena Creative WritingArena (LMArena)1464†–
Arena Multi-turnArena (LMArena)1469†–
Arena Longer QueriesArena (LMArena)1491†–
Multimodal
Arena VisionArena (LMArena)1284†–
LiveBench DesignLiveBench81.3%–
SAGEVals AI88.0%–
Blueprint-Bench 2Epoch AI Benchmarking Hub39.3%†–
Furniture AssemblyEpoch AI Benchmarking Hub75.0%–
VIALS-AAHandshake AI59.6%–
Code2Video-AAArtificial Analysis1443–
AA-3DArtificial Analysis1204–
FACTS MultimodalGoogle50.4%†–
Long context
AA-LCR v1.1Artificial Analysis82.7%–
MLCRArtificial Analysis41.7%–
FACTS GroundingGoogle62.5%†–
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub166.6†–
LiveBench 2.0LiveBench77.0%–
LiveBench 1.0LiveBench75.7%–
AA Intelligence Index v5.0.1Artificial Analysis54.5–
AA Intelligence Index v4.3.2Artificial Analysis56–
AA Progress Index v1Artificial Analysis350.5–
Vals IndexVals AI70.8–
Vals Finance IndexVals AI64.5%–
Vals Science IndexVals AI59.1%–
Vals Router IndexVals AI69.0%†–
Vals Legal IndexVals AI68.0%–
Safety & honesty
DistressBenchScale AI SEAL74.6%†–

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Claude Sonnet 5.5 (max): 36 new results (LiveBench 2.0, LiveBench Long Agentic, LiveBench 2.0 Reasoning…).
  • Claude Sonnet 5.5 (max): BenchLeader Index 65.1 → 64.6.
  • Muse Spark Open 816B A42B (xhigh): BenchLeader Index 58.6 → 58.1.
  • Claude Sonnet 5.5 (max): 1 new result (MirrorCode).
  • Claude Sonnet 5.5 (max): 2 score revisions.
  • Claude Sonnet 5.5 (max): 1 score revision.
  • Claude Sonnet 5.5 (max): 1 score revision.
  • Claude Sonnet 5.5 (max): 1 score revision.
  • Claude Sonnet 5.5 (max): 1 new result (MirrorCode).
  • Claude Sonnet 5.5 (max): 5 new results (AA Intelligence Index v5.0.1, AA Progress Index v1, HLE-Diamond (AA)…); 3 score revisions; cost per task moved from $5.46/M to $10.02/M (83% up).

Rankings: Best LLM overall · Best LLM for coding · Best LLM for agents · Best cheap LLMs

Claude Sonnet 5.5 vs Muse Spark Open 816B A42B: questions

Is Claude Sonnet 5.5 better than Muse Spark Open 816B A42B?
Claude Sonnet 5.5 (max) leads on quality: 64.2 vs 58.1. The BenchLeader Index combines every independent quality benchmark; Claude Sonnet 5.5 (max) is ahead overall as of 16 Nov 2026, but check the category scores for your use.
Claude Sonnet 5.5 vs Muse Spark Open 816B A42B: which is cheaper, and will that change?
Muse Spark Open 816B A42B is cheaper today: $2.00 against $4.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is Claude Sonnet 5.5 or Muse Spark Open 816B A42B better for coding?
Claude Sonnet 5.5 scores higher in coding (70 vs 65 on the category index, where 50 is average). On SciCode, the top shared coding benchmark, it is 61.0% for Claude Sonnet 5.5 against 58.5% for Muse Spark Open 816B A42B.
Which is better for long documents?
Both take about 1M tokens: Claude Sonnet 5.5 1,000,000, Muse Spark Open 816B A42B 1,048,576.
Do independent benchmarks agree on Claude Sonnet 5.5 vs Muse Spark Open 816B A42B?
Across the 6 benchmarks both have, Claude Sonnet 5.5 leads 5, Muse Spark Open 816B A42B leads 1. Every overall index that rates both puts Claude Sonnet 5.5 ahead.
More questions (1)
When was Muse Spark Open 816B A42B released?
Muse Spark Open 816B A42B was released on 15 Oct 2026.