BenchLeader

GPT-5.4 Nano vs Muse Spark Open

Full profiles: GPT-5.4 Nano (OpenAI) and Muse Spark Open (Meta): every benchmark, price and rank.

Updated · Data from 11 sources

As of 16 Nov 2026, GPT-5.4 Nano and Muse Spark Open are neck and neck on quality (53.9 vs 53.5 on the BenchLeader Index, inside the ±10.9 margin), and GPT-5.4 Nano is 4.3× cheaper at $0.463 vs $2.00 per 1M tokens blended. Choose GPT-5.4 Nano for coding (49 vs 36); choose Muse Spark Open for fast first answers (9.9 s vs 61.3 s) and multimodal (63 vs 47) and reasoning (51 vs 38).

Key facts (as of 16 Nov 2026)

  • GPT-5.4 Nano scores 53.9 on the BenchLeader Index and Muse Spark Open scores 53.5 (BenchLeader, 16 Nov 2026).
  • GPT-5.4 Nano costs $0.463 per 1M tokens blended (list price, 16 Nov 2026).
  • Muse Spark Open costs $2.00 per 1M tokens blended (list price, 16 Nov 2026).
  • Of the 16 benchmarks both models have, Muse Spark Open leads 15 (BenchLeader, 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingGPT-5.4 Nano49 vs 36 category score; SciCode (AA) 47.2% vs 58.5%High
ReasoningMuse Spark Open51 vs 38 category score; ARC-AGI-2 57.5% vs 5.7%High
Long documentsEither63 vs 64 category score; AA-LCR v1.1 76.7% vs 78.3%Either
Images and other mediaMuse Spark Open63 vs 47 category score; MMMU-Pro 80.9% vs 65.4%High
Lowest costGPT-5.4 Nano$0.463 vs $2.00 per 1M blended; agentic coding session $0.017 vs $0.092–
Fastest first answerMuse Spark Open9.9 s (Muse Spark Open (xhigh)) vs 61.3 s (GPT-5.4 Nano (xhigh)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GPT-5.4 Nano (xhigh) and Muse Spark Open (xhigh) are neck and neck on quality (53.9 vs 53.5, within the ±10.9 margin).
  • GPT-5.4 Nano (xhigh) is stronger in coding.
  • Muse Spark Open (xhigh) is stronger in long context, multimodal, reasoning.
  • GPT-5.4 Nano (xhigh) is 4.3× cheaper ($0.463 vs $2.00 per 1M blended).

At a glance

SpecGPT-5.4 NanoMuse Spark Open
DeveloperOpenAIMeta
Released17 Mar 202615 Oct 2026
Context window (tokens)400,0001,048,576
Compared atGPT-5.4 Nano (xhigh)Muse Spark Open (xhigh)
Open weightsNoYes
Price in / out / cached input per 1M$0.200 / $1.25 / $0.020$1.25 / $4.25 / $0.150

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGPT-5.4 Nano (xhigh)Muse Spark Open (xhigh)Leader
Reasoning37.951.3Muse Spark Open
Coding49.436.0GPT-5.4 Nano
Agents & tools60.8–not comparable
Knowledge–58.8not comparable
Instruction following74.1–not comparable
Multimodal47.463.3Muse Spark Open
Long context62.963.8level

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingLong contextMultimodalGPT-5.4 Nano, Reasoning: 37.9GPT-5.4 Nano, Coding: 49.4GPT-5.4 Nano, Long context: 62.9GPT-5.4 Nano, Multimodal: 47.4Muse Spark Open, Reasoning: 51.3Muse Spark Open, Coding: 36.0Muse Spark Open, Long context: 63.8Muse Spark Open, Multimodal: 63.3

Not drawn, measured for fewer than two of these models: Agents & tools, Maths, Knowledge, Instruction following, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 16 benchmarks both have, GPT-5.4 Nano leads 1, Muse Spark Open leads 15.

Overall indexGPT-5.4 Nano (xhigh)Muse Spark Open (xhigh)Leader
BenchLeader Index53.953.5neck and neck

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGPT-5.4 Nano (xhigh)Muse Spark Open (xhigh)
Blended price per 1M tokens$0.463$2.00
Input / output per 1M$0.200 / $1.25$1.25 / $4.25
Cached input per 1M$0.020$0.150
Price per task: chat reply$0.0005$0.0018
Price per task: summarize a 30-page report$0.0032$0.018
Price per task: code edit$0.0031$0.014
Price per task: agentic coding session$0.017$0.092
Price per task: structured extraction$0.0007$0.0034
Agentic coding session, input mostly cached$0.0089$0.043
Cost per benchmark task (AA Index)–$2.02
Output tokens per task (AA Index)–66k
Of which reasoning–32k
Time per task (AA Index)–6 min
Output speed145 tok/s180 tok/s
Time to first answer61.3 s9.9 s
Time to a complete answer, last measured 13 Nov 2026185.1 s39.9 s

Each model is compared at its best-ranked reasoning-effort setting. GPT-5.4 Nano (xhigh) scores 53.9 and takes 61 s to its first answer token; GPT-5.4 Nano (medium) scores 51.4 in 6 s, GPT-5.4 Nano (high) scores 48.3 in 1 s. Muse Spark Open (xhigh) scores 53.5 and takes 10 s to its first answer token. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

130 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGPT-5.4 Nano (xhigh)Muse Spark Open (xhigh)
BenchLeader IndexBenchLeader53.953.5
Agents & tools scoreBenchLeader60.8–
Coding scoreBenchLeader49.436.0
Instruction following scoreBenchLeader74.1–
Long context scoreBenchLeader62.963.8
Multimodal scoreBenchLeader47.463.3
Reasoning scoreBenchLeader37.951.3
Knowledge scoreBenchLeader–58.8
Blended price $/MBenchLeader$0.463$2.00
Output speedBenchLeader145 tok/s180 tok/s
Time to first answerBenchLeader61.3 s9.9 s
Context windowBenchLeader400,000 tokens1,048,576 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub78.5%†–
Arena Hard PromptsArena (LMArena)1421†–
LiveBench 2.0 ReasoningLiveBench–73.7%†
LiveBench 1.0 ReasoningLiveBench81.1%–
GPQA Diamond (AA)Artificial Analysis81.7%89.0%
Humanity's Last Exam (AA)Artificial Analysis28.3%43.9%
HLE-Diamond (AA)Artificial Analysis–26.3%
GPQA Diamond (Vals)Vals AI77.5%†–
Kagi LLM BenchmarkKagi LLM Benchmark39.7%†–
ARC-AGI-1ARC Prize51.5%89.0%
ARC-AGI-2ARC Prize5.7%57.5%
ARC-AGI-3ARC Prize–0.4%
CritPtArtificial Analysis9.3%14.9%
CritPt v2 hard subset (AA)Artificial Analysis–29.5%
HLE-Diamond (Scale)Scale AI SEAL–28.0%†
Arena ExpertArena (LMArena)1436†–
Chess PuzzlesEpoch AI Benchmarking Hub45.0%–
Mystery Game PuzzlesEpoch AI Benchmarking Hub6.0%†–
LMCAEpoch AI Benchmarking Hub36.9%–
DTBenchEpoch AI Benchmarking Hub80.3%–
ForecastBenchForecastBench58.6%†–
Coding
SciCodeSciCode47.2%–
WeirdMLWeirdML49.2%†–
Arena CodingArena (LMArena)1460†–
Arena WebDevArena (LMArena)–1526†
Show all 130 benchmarks
MetricPublisherGPT-5.4 Nano (xhigh)Muse Spark Open (xhigh)
Coding
LiveBench 2.0 CodingLiveBench–55.1%†
LiveBench 1.0 CodingLiveBench70.8%–
SciCode (AA)Artificial Analysis47.2%58.5%
LiveCodeBenchVals AI84.0%†–
SWE-bench (Vals)Vals AI69.8%†–
Code MigrationVals AI14.5%†21.2%
Code Migration v1.1Vals AI–26.9%
Vibe Code Bench v1.1Vals AI26.1%†76.2%
SWE Atlas v1.1Scale AI SEAL–42.3%†
SWE Atlas v1.1: Codebase QnAScale AI SEAL–50.0%†
SWE Atlas v1.1: Test WritingScale AI SEAL–41.1%†
SWE Atlas v1.1: RefactoringScale AI SEAL–35.7%†
SWE-Bench Pro V2Scale AI SEAL–95.0%
SWE-Bench Pro V2 HARDScale AI SEAL–82.3%
ALE-BenchEpoch AI Benchmarking Hub1004.5†–
Terminal-Bench 4.0 (AA)Artificial Analysis0.5%8.1%
Terminal-Bench 2.1 (AA)Artificial Analysis60.7%76.4%
GameBench 2 OverallDuelLab GameBench 2–55.3†
GameBench 2 by reasoning settingDuelLab GameBench 231.1†59.3
Design Arena WebsiteDesign Arena–1305
FrontierCode 1.1 (AA)Artificial Analysis–27.6%
FrontierCode 2.0 (AA)Artificial Analysis–7.6%
Agents & tools
LiveBench Long AgenticLiveBench–12.1%†
LiveBench BrowserLiveBench–26.2%†
LiveBench Agentic CodingLiveBench46.8%–
Terminal-Bench HardArtificial Analysis42.4%–
τ²-Bench Telecom (AA)Artificial Analysis76.0%–
Terminal-Bench 2.1 (Vals)Vals AI41.6%†–
HiL-BenchScale AI SEAL–59.7%†
GDPval-AA v2.1, normalised scoreArtificial Analysis–45.1%
GDPval-AA v2.1Artificial Analysis9541401
τ³-Banking (AA)Artificial Analysis27.4%–
ITBench SRE (AA)Artificial Analysis24.4%–
APEX-Agents (AA)Artificial Analysis24.9%–
Finance Agent v2Vals AI38.2%†61.3%
Finance Agent v2.1Vals AI–60.7%
Harvey's Legal Agent Benchmark v1.1Vals AI–25.0%
Harvey's Legal Agent Benchmark v1Vals AI0.0%†16.7%
Legal Research BenchVals AI6.3%†38.5%
Tax Agent BenchVals AI5.0%†26.3%
Terminal-Bench 2.0 (Vals)Vals AI39.9%†–
Terminal-Bench 4.0 (Vals)Vals AI–6.6%
AutomationBenchArtificial Analysis6.0%49.7%
GDP.pdf (AA)Artificial Analysis7.8%18.6%
EnterpriseOps-GymArtificial Analysis31.5%–
AA-Briefcase v1.1Artificial Analysis6741280
GDPxGDPx by SemiAnalysis–1.7%†
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–1.9%
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub44.9%†–
FrontierMath Tier 4Epoch AI Benchmarking Hub12.2%†–
OTIS Mock AIMEEpoch AI Benchmarking Hub87.8%†–
ProofBenchVals AI5.0%†–
LiveBench MathematicsLiveBench91.0%–
AIME (Vals)Vals AI88.8%†–
ArXivMathMathArena–27.0%
BrokenArXivMathArena–30.1%
Arena MathsArena (LMArena)1424†–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub11.7%†–
LiveBench 2.0 Data AnalysisLiveBench–60.2%†
LiveBench ResearchLiveBench–82.7%†
LiveBench 1.0 Data AnalysisLiveBench67.6%–
AA-Omniscience v1.1Artificial Analysis–25.8
MMLU-ProVals AI77.2%†–
LegalBenchVals AI77.9%†–
CorpFinVals AI61.2%†–
TaxEvalVals AI67.4%†–
PRBench LegalScale AI SEAL–59.8%†
CaseLaw v2Vals AI51.9%†–
Excel Modeling BenchmarkVals AI44.8%†53.7%
Excel Modeling Benchmark v1.1Vals AI–62.0%
MedCodeVals AI41.0%†–
MedScribeVals AI77.1%†–
AA-Omniscience v1.1: accuracyArtificial Analysis–42.0%
AA-Omniscience v1.1: non-hallucinationArtificial Analysis–72.0%
Instruction following
LiveBench LanguageLiveBench62.5%–
LiveBench Instruction FollowingLiveBench67.2%–
IFBenchArtificial Analysis75.9%–
MultiChallengeScale AI SEAL–74.2%†
Arena Instruction FollowingArena (LMArena)1386†–
Human preference
Arena TextArena (LMArena)1401†–
Arena Creative WritingArena (LMArena)1337†–
Arena Multi-turnArena (LMArena)1414†–
Arena Longer QueriesArena (LMArena)1403†–
Multimodal
Arena VisionArena (LMArena)1196†–
LiveBench DesignLiveBench–58.1%†
MMMU-ProArtificial Analysis65.4%80.9%
MMMU-Pro (Vals)Vals AI73.6%†–
MortgageTaxVals AI59.1%†–
SAGEVals AI–85.8%
Humanity's Sixth SenseScale AI SEAL–29.6%†
Long context
AA-LCR v1.1Artificial Analysis76.7%78.3%
MLCRArtificial Analysis16.1%7.8%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub146.4†155.4†
LiveBench 2.0LiveBench–48.5%†
LiveBench 1.0LiveBench69.6%–
AA Intelligence Index v5.0.1Artificial Analysis–24.9
AA Intelligence Index v4.3.2Artificial Analysis20.738.9
AA Progress Index v1Artificial Analysis270.1306.7
Vals IndexVals AI–48.6
Vals Finance IndexVals AI–53.0%
Vals Multimodal IndexVals AI47.6%†–
Vals Legal IndexVals AI–68.5%
Safety & honesty
FORTRESSScale AI SEAL–7.6%†
DistressBenchScale AI SEAL–87.7%†
Metadata
AA Openness IndexArtificial Analysis–27.8

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • GPT-5.4 Nano (xhigh): 2 new results (GDPval-AA v2.1, AA-Briefcase v1.1).
  • Muse Spark Open (xhigh): 1 score revision.
  • Muse Spark Open (xhigh): 1 new result (GameBench 2 by reasoning setting); 1 score revision.
  • Muse Spark Open (xhigh): BenchLeader Index 53.3 → 53.8.
  • Muse Spark Open (xhigh): 1 new result (ARC-AGI-3).
  • GPT-5.4 Nano (xhigh): BenchLeader Index 53.6 → 54.1.
  • Muse Spark Open (xhigh): BenchLeader Index 59.5 → 53.3.
  • GPT-5.4 Nano (xhigh): 1 new result (AA Progress Index v1).
  • Muse Spark Open (xhigh): 6 new results (AA Intelligence Index v5.0.1, AA Progress Index v1, HLE-Diamond (AA)…); 3 score revisions; cost per task moved from $0.84/M to $2.02/M (139% up).
  • Muse Spark Open (xhigh): 6 new results (MLCR, Code Migration v1.1, Excel Modeling Benchmark v1.1…); cached input price moved from $1.25/M to $0.15/M (88% down).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

GPT-5.4 Nano vs Muse Spark Open: questions

Is GPT-5.4 Nano better than Muse Spark Open?
GPT-5.4 Nano (xhigh) and Muse Spark Open (xhigh) are neck and neck on quality (53.9 vs 53.5, within the ±10.9 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 16 Nov 2026, so check the category scores for your use.
GPT-5.4 Nano vs Muse Spark Open: which is cheaper, and will that change?
GPT-5.4 Nano is cheaper today: $0.463 against $2.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is GPT-5.4 Nano or Muse Spark Open better for coding?
GPT-5.4 Nano scores higher in coding (49 vs 36 on the category index, where 50 is average).
Which is faster, GPT-5.4 Nano or Muse Spark Open?
Muse Spark Open streams faster (180 vs 145 output tokens per second, Artificial Analysis 7-day median).
Which is better for long documents?
They are level on long-context benchmarks (63 vs 64). Muse Spark Open accepts more context: 1,048,576 against 400,000 tokens for GPT-5.4 Nano.
More questions (3)
Which has lower latency?
Muse Spark Open answers first: 9.9 s against 61.3 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Do independent benchmarks agree on GPT-5.4 Nano vs Muse Spark Open?
Across the 16 benchmarks both have, GPT-5.4 Nano leads 1, Muse Spark Open leads 15.
When was Muse Spark Open released?
Muse Spark Open was released on 15 Oct 2026.