BenchLeader

GPT-5.4 Pro vs Muse Spark 1.2

Full profiles: GPT-5.4 Pro (OpenAI) and Muse Spark 1.2 (Meta): every benchmark, price and rank.

Updated · Data from 8 sources

As of 25 Oct 2026, GPT-5.4 Pro and Muse Spark 1.2 (xhigh) are neck and neck on quality (63.3 vs 63.2 on the BenchLeader Index, inside the ±5.7 margin of error), and Muse Spark 1.2 (xhigh) costs 34× less, which makes it the better buy for most workloads. GPT-5.4 Pro leads in every category we measure both in.

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
ReasoningGPT-5.4 Pro73 vs 69 category scoreMedium
KnowledgeGPT-5.4 Pro74 vs 67 category scoreMedium
Images and other mediaGPT-5.4 Pro70 vs 65 category scoreMedium
Chat quality (human preference)–Only Muse Spark 1.2 has an Arena rating (69 category score)Not comparable
Lowest costMuse Spark 1.2$2.00 vs $67.50 per 1M blended; agentic coding session $0.092 vs $2.52–
Fastest first answerGPT-5.4 Pro6.1 s (GPT-5.4 Pro) vs 17.6 s (Muse Spark 1.2 (xhigh)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GPT-5.4 Pro and Muse Spark 1.2 (xhigh) are neck and neck on quality (63.3 vs 63.2, within the ±5.7 margin).
  • GPT-5.4 Pro is stronger in instruction following, knowledge, multimodal, reasoning.
  • Muse Spark 1.2 (xhigh) is stronger in agents & tools, coding, composite, human preference, long context, maths.
  • Muse Spark 1.2 (xhigh) is 34× cheaper ($2.00 vs $67.50 per 1M blended).
  • Muse Spark 1.2 (xhigh) streams 43.9× faster (307 vs 7 tokens per second).

At a glance

SpecGPT-5.4 ProMuse Spark 1.2
DeveloperOpenAIMeta
Released4 Mar 20265 Aug 2026
Context window (tokens)1,050,0001,048,576
Compared atGPT-5.4 ProMuse Spark 1.2 (xhigh)
Open weightsNoNo
Price in / out / cached input per 1M$30.00 / $180.00 / –$1.25 / $4.25 / $0.150

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGPT-5.4 ProMuse Spark 1.2 (xhigh)Leader
Reasoning72.569.3GPT-5.4 Pro
Coding–55.1not comparable
Agents & tools–55.4not comparable
Maths–67.3not comparable
Knowledge73.666.7GPT-5.4 Pro
Instruction following63.8–not comparable
Human preference–68.6not comparable
Multimodal69.865.2GPT-5.4 Pro
Long context–64.5not comparable
Composite–73.8not comparable

Where sources disagree

Across the 0 benchmarks both have, GPT-5.4 Pro leads 0, Muse Spark 1.2 leads 0.

Overall indexGPT-5.4 ProMuse Spark 1.2 (xhigh)Leader
BenchLeader Index63.363.2neck and neck

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureGPT-5.4 ProMuse Spark 1.2 (xhigh)
Blended price per 1M tokens$67.50$2.00
Input / output per 1M$30.00 / $180.00$1.25 / $4.25
Cached input per 1M–$0.150
Price per task: chat reply$0.066$0.0018
Price per task: summarize a 30-page report$0.468$0.018
Price per task: code edit$0.450$0.014
Price per task: agentic coding session$2.52$0.092
Price per task: structured extraction$0.096$0.0034
Cost to run a full benchmark suite–$0.975
Output speed7 tok/s307 tok/s
Time to first answer6.1 s17.6 s
Time to a complete answer–19.2 s

Each model is compared at its best-ranked reasoning-effort setting. GPT-5.4 Pro scores 63.3 and takes 6 s to its first answer token; GPT-5.4 Pro (xhigh) scores 61.9 in 6 s. Muse Spark 1.2 (xhigh) scores 63.2 and takes 18 s to its first answer token. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

97 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGPT-5.4 ProMuse Spark 1.2 (xhigh)
BenchLeader IndexBenchLeader63.363.2
Instruction following scoreBenchLeader63.8–
Knowledge scoreBenchLeader73.666.7
Multimodal scoreBenchLeader69.865.2
Reasoning scoreBenchLeader72.569.3
Agents & tools scoreBenchLeader–55.4
Coding scoreBenchLeader–55.1
Composite scoreBenchLeader–73.8
Human preference scoreBenchLeader–68.6
Long context scoreBenchLeader–64.5
Maths scoreBenchLeader–67.3
Blended price $/MBenchLeader$67.50$2.00
Output speedBenchLeader7 tok/s307 tok/s
Time to first answerBenchLeader6.1 s17.6 s
Context windowBenchLeader1,050,000 tokens1,048,576 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub94.6%†–
Humanity's Last ExamScale AI / CAIS44.3%–
SimpleBenchSimpleBench74.1%74.5%†
Arena Hard PromptsArena (LMArena)–1512
LiveBench 2.0 ReasoningLiveBench–90.0%†
LiveBench 1.0 ReasoningLiveBench–90.0%
GPQA Diamond (AA)Artificial Analysis–90.4%
Humanity's Last Exam (AA)Artificial Analysis–45.5%
ARC-AGI-1ARC Prize94.5%†–
ARC-AGI-2ARC Prize83.3%†–
CritPtArtificial Analysis30.0%†17.7%
Chess PuzzlesEpoch AI Benchmarking Hub59.0%†27.0%
LMCAEpoch AI Benchmarking Hub–48.4%
DTBenchEpoch AI Benchmarking Hub–94.7%
Coding
SciCodeSciCode–57.4%
WeirdMLWeirdML57.4%†60.3%
Arena CodingArena (LMArena)–1541
Arena WebDevArena (LMArena)–1533
LiveBench 2.0 CodingLiveBench–78.2%†
LiveBench 1.0 CodingLiveBench–77.5%
IOIVals AI–21.8%
SWE-bench (Vals)Vals AI–86.6%
Code MigrationVals AI–29.9%
ProgramBenchVals AI–0.5%
Vibe Code Bench v1.1Vals AI–79.1%
Show all 97 benchmarks
MetricPublisherGPT-5.4 ProMuse Spark 1.2 (xhigh)
Coding
DeepSWE v1.1Epoch AI Benchmarking Hub–54.9%
FrontierSWEEpoch AI Benchmarking Hub–12.0%
Terminal-Bench 4.0 (AA)Artificial Analysis–7.1%
Terminal-Bench 2.1 (AA)Artificial Analysis–80.2%
Startrise FrontendStartrise–70.3%†
Agents & tools
APEX-AgentsMercor–45.4%†
Arena AgentArena (LMArena)–-7
LiveBench Long AgenticLiveBench–21.3%†
LiveBench BrowserLiveBench–36.0%†
LiveBench Agentic CodingLiveBench–57.6%
Terminal-Bench 2.1 (Vals)Vals AI–69.7%
τ³-Banking (AA)Artificial Analysis–34.9%
CyberBenchVals AI–69.5%
Finance Agent v2Vals AI–60.6%
Harvey's Legal Agent Benchmark v1Vals AI–25.4%
Legal Research BenchVals AI–43.8%
SkillsBenchVals AI–53.0%
SREBenchVals AI–0.0%
Tax Agent BenchVals AI–32.8%
Terminal-Bench 4.0 (Vals)Vals AI–6.1%
AutomationBenchArtificial Analysis–40.6%
GDP.pdf (AA)Artificial Analysis–17.4%
EnterpriseOps-GymArtificial Analysis–47.3%
AA-Briefcase v1.1Artificial Analysis–1327
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub82.5%†–
FrontierMath Tier 4Epoch AI Benchmarking Hub58.5%†–
ProofBenchVals AI–43.0%†
LiveBench MathematicsLiveBench–91.2%
MathArena ApexMathArena69.8%†–
Arena MathsArena (LMArena)–1491
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub46.3%†60.3%
LiveBench 2.0 Data AnalysisLiveBench–76.5%†
LiveBench ResearchLiveBench–67.7%†
LiveBench 1.0 Data AnalysisLiveBench–76.5%
AA-OmniscienceArtificial Analysis–27.2
MMLU-ProVals AI–88.3%
LegalBenchVals AI–85.3%
CorpFinVals AI–70.9%
TaxEvalVals AI–80.4%
MultiNRCScale AI SEAL62.3%–
BioMysteryBenchVals AI–64.8%
Excel Modeling BenchmarkVals AI–57.0%
MedCodeVals AI–49.4%
MedScribeVals AI–90.1%
Public Benefits Bench v1.1Vals AI–68.5%
GDP.pdfEpoch AI Benchmarking Hub–16.0%
AA-Omniscience: accuracyArtificial Analysis–45.4%
AA-Omniscience: non-hallucinationArtificial Analysis–66.7%
Instruction following
LiveBench LanguageLiveBench–78.6%
LiveBench Instruction FollowingLiveBench–74.3%
MultiChallengeScale AI SEAL69.2%–
TutorBenchScale AI SEAL56.6%–
Arena Instruction FollowingArena (LMArena)–1472
Human preference
Arena TextArena (LMArena)–1491
Arena Creative WritingArena (LMArena)–1439
Arena Multi-turnArena (LMArena)–1511
Arena Longer QueriesArena (LMArena)–1488
Multimodal
Arena VisionArena (LMArena)–1304
LiveBench DesignLiveBench–67.1%†
VISTAScale AI SEAL53.9%–
MMMU-Pro (Vals)Vals AI–86.1%
MortgageTaxVals AI–65.4%
SAGEVals AI–47.7%
Long context
AA-LCRArtificial Analysis–79.0%
MLCRArtificial Analysis–7.2%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub159.6155.1†
LiveBench 2.0LiveBench–62.4%†
LiveBench 1.0LiveBench–78.0%
AA Intelligence Index v4.3.2Artificial Analysis–39.6
Vals Multimodal IndexVals AI–69.8%†
Safety & honesty
FORTRESSScale AI SEAL14.8%–
MASKScale AI SEAL91.7%–

Data as of 2026-10-25. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Muse Spark 1.2 (xhigh): 1 new result (AA-Briefcase v1.1).
  • Muse Spark 1.2 (xhigh): 1 new result (Harvey's Legal Agent Benchmark v1).
  • GPT-5.4 Pro: 1 score revision.
  • Muse Spark 1.2 (xhigh): 2 score revisions.
  • Muse Spark 1.2 (xhigh): BenchLeader Index 62.6 → 63.3.
  • Muse Spark 1.2 (xhigh): 4 new results (AutomationBench, GDP.pdf (AA), MLCR…).
  • Muse Spark 1.2 (xhigh): 3 new results (Chess Puzzles, ProgramBench, SREBench); 1 score revision.
  • Muse Spark 1.2 (xhigh): 3 score revisions.
  • Muse Spark 1.2 (xhigh): 1 score revision.
  • GPT-5.4 Pro: BenchLeader Index 62.1 → 63.6.

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

GPT-5.4 Pro vs Muse Spark 1.2: questions

Is GPT-5.4 Pro better than Muse Spark 1.2?
GPT-5.4 Pro and Muse Spark 1.2 (xhigh) are neck and neck on quality (63.3 vs 63.2, within the ±5.7 margin). The BenchLeader Index combines every independent quality benchmark; the two are within the margin of error as of 2026-10-25, so check the category scores for your use.
Which is cheaper, GPT-5.4 Pro or Muse Spark 1.2, and will that change?
Muse Spark 1.2 is cheaper today: $2.00 against $67.50 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Which is better for long documents?
Both take about 1.1M tokens: GPT-5.4 Pro 1,050,000, Muse Spark 1.2 1,048,576.
Which has lower latency?
GPT-5.4 Pro answers first: 6.1 s against 17.6 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Which is faster, GPT-5.4 Pro or Muse Spark 1.2?
Muse Spark 1.2 streams faster: 307 against 7 output tokens per second.
When was Muse Spark 1.2 released?
Muse Spark 1.2 was released on 5 Aug 2026.