BenchLeader

Agnes 2.5 Pro Beta vs Muse Spark 1.3

Full profiles: Agnes 2.5 Pro Beta (Sapiens AI) and Muse Spark 1.3 (Meta): every benchmark, price and rank.

Updated · Data from 8 sources

As of 16 Nov 2026, there are not enough shared benchmarks for a verdict, and Agnes 2.5 Pro Beta is 13× cheaper at $0.150 vs $2.00 per 1M tokens blended. Agnes 2.5 Pro Beta leads in every category we measure both in.

Key facts (as of 16 Nov 2026)

  • Agnes 2.5 Pro Beta costs $0.150 per 1M tokens blended (list price, 16 Nov 2026).
  • Muse Spark 1.3 costs $2.00 per 1M tokens blended (list price, 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
Agents & tool useAgnes 2.5 Pro Beta64 vs 61 category scoreMedium
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Not enough shared benchmarks for a verdict.
  • Agnes 2.5 Pro Beta is stronger in agents & tools.
  • Agnes 2.5 Pro Beta is 13× cheaper ($0.150 vs $2.00 per 1M blended).

At a glance

SpecAgnes 2.5 Pro BetaMuse Spark 1.3
DeveloperSapiens AIMeta
Released26 Aug 20262 Sep 2026
Context window (tokens)1,000,0001,048,576
Compared atAgnes 2.5 Pro BetaMuse Spark 1.3
Open weightsNoNo
Price in / out / cached input per 1M–$1.25 / $4.25 / $0.150

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryAgnes 2.5 Pro BetaMuse Spark 1.3Leader
Reasoning–71.0not comparable
Agents & tools64.461.3Agnes 2.5 Pro Beta
Maths–56.3not comparable
Knowledge–81.2not comparable
Multimodal57.7–not comparable
Long context66.2–not comparable

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningAgents & toolsMathsKnowledgeLong contextMultimodalAgnes 2.5 Pro Beta, Agents & tools: 64.4Agnes 2.5 Pro Beta, Long context: 66.2Agnes 2.5 Pro Beta, Multimodal: 57.7Muse Spark 1.3, Reasoning: 71.0Muse Spark 1.3, Agents & tools: 61.3Muse Spark 1.3, Maths: 56.3Muse Spark 1.3, Knowledge: 81.2

Dashed: that model has no result on the axis it crosses; the line only joins its neighbours.

Not drawn, no result for these models: Coding, Instruction following, Human preference.

Model, click to add or removeIndex

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureAgnes 2.5 Pro BetaMuse Spark 1.3
Blended price per 1M tokens–$2.00
Input / output per 1M– / –$1.25 / $4.25
Cached input per 1M–$0.150
Price per task: chat reply–$0.0018
Price per task: summarize a 30-page report–$0.018
Price per task: code edit–$0.014
Price per task: agentic coding session–$0.092
Price per task: structured extraction–$0.0034
Agentic coding session, input mostly cached–$0.043
Output speed–163 tok/s
Time to first answer–2.6 s

Each model is compared at its best-ranked reasoning-effort setting. Agnes 2.5 Pro Beta. Muse Spark 1.3 scores 61.6 and takes 3 s to its first answer token; Muse Spark 1.3 (max) scores 60.6 in 31 s, Muse Spark 1.3 (xhigh) scores 58.1 in 11 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

122 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherAgnes 2.5 Pro BetaMuse Spark 1.3
BenchLeader IndexBenchLeader–61.6
Agents & tools scoreBenchLeader64.461.3
Long context scoreBenchLeader66.2–
Multimodal scoreBenchLeader57.7–
Knowledge scoreBenchLeader–81.2
Maths scoreBenchLeader–56.3
Reasoning scoreBenchLeader–71.0
Blended price $/MBenchLeader–$2.00
Output speedBenchLeader–163 tok/s
Time to first answerBenchLeader–2.6 s
Context windowBenchLeader1,000,000 tokens1,048,576 tokens
Reasoning
SimpleBenchSimpleBench–81.8%
Arena Hard PromptsArena (LMArena)–1517†
LiveBench 2.0 ReasoningLiveBench–89.7%†
LiveBench 1.0 ReasoningLiveBench–89.7%†
GPQA Diamond (AA)Artificial Analysis90.5%93.5%†
Humanity's Last Exam (AA)Artificial Analysis37.5%48.7%†
HLE-Diamond (AA)Artificial Analysis–33.7%†
CritPtArtificial Analysis15.7%24.9%†
CritPt v2 hard subset (AA)Artificial Analysis–48.0%†
MysteryMechanismVals AI–36.0%†
HLE-Diamond (Scale)Scale AI SEAL–25.4%
Arena ExpertArena (LMArena)–1521†
Chess PuzzlesEpoch AI Benchmarking Hub–37.0%†
Mystery Game PuzzlesEpoch AI Benchmarking Hub–25.0%†
LMCAEpoch AI Benchmarking Hub–53.9%
DTBenchEpoch AI Benchmarking Hub–96.5%
ForecastBenchForecastBench–65.5%†
BTF-3Epoch AI Benchmarking Hub–14.1%†
Coding
SciCodeSciCode–58.8%†
Arena CodingArena (LMArena)–1534†
Arena WebDevArena (LMArena)–1655†
LiveBench 2.0 CodingLiveBench–84.4%†
LiveBench 1.0 CodingLiveBench–81.1%†
SciCode (AA)Artificial Analysis48.8%58.8%†
IOIVals AI–56.6%†
Show all 122 benchmarks
MetricPublisherAgnes 2.5 Pro BetaMuse Spark 1.3
Coding
Code MigrationVals AI–47.4%†
ProgramBenchVals AI–2.5%†
SWE-bench MultimodalVals AI–43.1%†
Vibe Code Bench 1-100Vals AI–20.5%†
Vibe Code Bench v1.1Vals AI–85.9%†
MirrorCodeEpoch AI Benchmarking Hub–54.4%†
CursorBenchCursor–41.6%†
ALE-BenchEpoch AI Benchmarking Hub–1688.3†
FrontierSWEEpoch AI Benchmarking Hub–25.8%†
WeirdML v3WeirdML–6.7%†
Terminal-Bench 4.0 (AA)Artificial Analysis–33.3%†
Terminal-Bench 2.1 (AA)Artificial Analysis69.7%84.3%†
Startrise FrontendStartrise–74.7%
GameBench 2 OverallDuelLab GameBench 2–57.7
GameBench 2 by reasoning settingDuelLab GameBench 2–68.5†
Design Arena WebsiteDesign Arena–1353†
FrontierCode 1.1 (AA)Artificial Analysis–40.6%†
FrontierCode 2.0 (AA)Artificial Analysis–23.1%†
Agents & tools
Terminal-BenchTerminal-Bench–14.8%†
APEX-AgentsMercor–58.6%
Arena AgentArena (LMArena)–2.2†
LiveBench Long AgenticLiveBench–47.9%†
LiveBench BrowserLiveBench–30.9%†
LiveBench Agentic CodingLiveBench–64.1%†
Terminal-Bench 2.1 (Vals)Vals AI–79.0%†
HiL-BenchScale AI SEAL–66.9%
GDPval-AA v2.1, normalised scoreArtificial Analysis41.5%–
GDPval-AA v2.1Artificial Analysis13351681†
τ³-Banking (AA)Artificial Analysis35.7%50.5%†
ITBench SRE (AA)Artificial Analysis–33.2%†
Analyst Agent (AA)Artificial Analysis–37.5%†
CUA-benchVals AI–5.8%†
CyberBenchVals AI–72.7%†
Finance Agent v2Vals AI–60.0%†
Harvey's Legal Agent Benchmark v1Vals AI–23.8%†
Legal Research BenchVals AI–55.3%†
SREBenchVals AI–3.8%†
Tax Agent BenchVals AI–42.4%†
Terminal-Bench 4.0 (Vals)Vals AI–24.8%†
Terminal-Bench ScienceVals AI–10.0%†
Arena Agent Task CompletionArena (LMArena)–3.7†
AutomationBenchArtificial Analysis–57.9%†
GDP.pdf (AA)Artificial Analysis–26.6%†
Harvey LAB-AA v1.1Harvey–8.9%†
AA-Briefcase v1.1Artificial Analysis–1581†
Design Arena AgenticDesign Arena–1283†
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–10.9%†
CWE-Bench (AA)Artificial Analysis–60.8%†
DeepSec-Bench (AA)Artificial Analysis–12.5%†
CyberGym end-to-end (AA)Artificial Analysis–59.5%†
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub–74.0%†
FrontierMath Tier 4Epoch AI Benchmarking Hub–46.3%†
OTIS Mock AIMEEpoch AI Benchmarking Hub–99.2%†
ProofBenchVals AI–55.0%
LiveBench MathematicsLiveBench–96.0%†
Arena MathsArena (LMArena)–1506†
Knowledge
LiveBench 2.0 Data AnalysisLiveBench–79.6%†
LiveBench ResearchLiveBench–82.5%†
LiveBench 1.0 Data AnalysisLiveBench–79.6%†
AA-Omniscience v1.1Artificial Analysis–22.4†
PRBench FinanceScale AI SEAL–59.5%
PRBench LegalScale AI SEAL–61.6%
Excel Modeling BenchmarkVals AI–67.4%†
Access to Justice BenchmarkVals AI–72.2%†
Financial Coaching BenchVals AI–70.3%†
Immigration BenchVals AI–64.9%†
DrugDiscoveryBenchScale AI SEAL–62.2%†
GDP.pdfEpoch AI Benchmarking Hub–27.6%
AA-Omniscience v1.1: accuracyArtificial Analysis–38.0%†
AA-Omniscience v1.1: non-hallucinationArtificial Analysis–74.8%†
Instruction following
LiveBench LanguageLiveBench–82.8%†
LiveBench Instruction FollowingLiveBench–78.0%†
Arena Instruction FollowingArena (LMArena)–1485†
Human preference
Arena TextArena (LMArena)–1497†
EQ-Bench Creative Writing v3EQ-Bench–1907
Arena Creative WritingArena (LMArena)–1468†
Arena Multi-turnArena (LMArena)–1493†
Arena Longer QueriesArena (LMArena)–1498†
Multimodal
Arena VisionArena (LMArena)–1310†
LiveBench DesignLiveBench–74.8%†
MMMU-ProArtificial Analysis75.4%82.0%†
Humanity's Sixth SenseScale AI SEAL–37.4%†
GeoBenchGeoBench–86.0%
Code2Video-AAArtificial Analysis–1019†
AA-3DArtificial Analysis–1032†
Long context
AA-LCR v1.1Artificial Analysis83.0%83.0%†
Arena DocumentArena (LMArena)–1474†
MLCRArtificial Analysis–13.9%†
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub–158.2
LiveBench 2.0LiveBench–68.6%†
LiveBench 1.0LiveBench–81.6%†
AA Intelligence Index v5.0.1Artificial Analysis–36.6†
AA Intelligence Index v4.3.2Artificial Analysis35.248.1†
AA Progress Index v1Artificial Analysis299.1324.5†
Vals RSI IndexVals AI–19.6%†
AA Cyber IndexArtificial Analysis–44.3†
Safety & honesty
DistressBenchScale AI SEAL–84.9%

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Muse Spark 1.3: BenchLeader Index 60.2 → 61.6.
  • Muse Spark 1.3: 1 score revision.
  • Muse Spark 1.3: BenchLeader Index 59.2 → 60.2.
  • Muse Spark 1.3: 2 new results (SimpleBench, GeoBench).
  • Muse Spark 1.3: BenchLeader Index 57.7 → 59.2.
  • Muse Spark 1.3: 4 score revisions.
  • Muse Spark 1.3: BenchLeader Index 58.2 → 57.7.
  • Muse Spark 1.3: 1 score revision.
  • Muse Spark 1.3: 1 score revision.
  • Agnes 2.5 Pro Beta: 1 new result (AA Progress Index v1).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Agnes 2.5 Pro Beta vs Muse Spark 1.3: questions

Agnes 2.5 Pro Beta vs Muse Spark 1.3: which is cheaper, and will that change?
Agnes 2.5 Pro Beta is cheaper today: $0.150 against $2.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is Agnes 2.5 Pro Beta or Muse Spark 1.3 better for agents and tool use?
Agnes 2.5 Pro Beta scores higher in agentic tasks (64 vs 61 on the category index, where 50 is average).
Which is better for long documents?
Both take about 1M tokens: Agnes 2.5 Pro Beta 1,000,000, Muse Spark 1.3 1,048,576.
When was Muse Spark 1.3 released?
Muse Spark 1.3 was released on 2 Sep 2026.