BenchLeader

Agnes 2.5 Pro Beta vs Claude Opus 5

Full profiles: Agnes 2.5 Pro Beta (Sapiens AI) and Claude Opus 5 (Anthropic): every benchmark, price and rank.

Updated · Data from 12 sources

As of 16 Nov 2026, there are not enough shared benchmarks for a verdict, and Agnes 2.5 Pro Beta is 67× cheaper at $0.150 vs $10.00 per 1M tokens blended. Choose Agnes 2.5 Pro Beta for long context (66 vs 64); choose Claude Opus 5 for multimodal (67 vs 58).

Key facts (as of 16 Nov 2026)

  • Agnes 2.5 Pro Beta costs $0.150 per 1M tokens blended (list price, 16 Nov 2026).
  • Claude Opus 5 costs $10.00 per 1M tokens blended (list price, 16 Nov 2026).
  • Of the 10 benchmarks both models have, Claude Opus 5 leads 9 (BenchLeader, 16 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
Agents & tool useEither64 vs 64 category score; τ³-Banking (AA) 35.7% vs 42.1%Either
Long documentsAgnes 2.5 Pro Beta66 vs 64 category score; AA-LCR v1.1 83.0% vs 79.3%Medium
Images and other mediaClaude Opus 567 vs 58 category score; MMMU-Pro 84.7% vs 75.4%High
Chat quality (human preference)–Only Claude Opus 5 has an Arena rating (68 category score)Not comparable
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Not enough shared benchmarks for a verdict.
  • Agnes 2.5 Pro Beta is stronger in agents & tools, long context.
  • Claude Opus 5 (max) is stronger in multimodal.
  • Agnes 2.5 Pro Beta is 67× cheaper ($0.150 vs $10.00 per 1M blended).

At a glance

SpecAgnes 2.5 Pro BetaClaude Opus 5
DeveloperSapiens AIAnthropic
Released26 Aug 202624 Jul 2026
Context window (tokens)1,000,0001,000,000
Compared atAgnes 2.5 Pro BetaClaude Opus 5 (max)
Open weightsNoNo
Price in / out / cached input per 1M–$5.00 / $25.00 / $0.500

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryAgnes 2.5 Pro BetaClaude Opus 5 (max)Leader
Reasoning–66.1not comparable
Coding–67.0not comparable
Agents & tools64.463.8level
Maths–69.8not comparable
Knowledge–65.2not comparable
Human preference–68.1not comparable
Multimodal57.767.2Claude Opus 5
Long context66.264.3Agnes 2.5 Pro Beta

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75Agents & toolsLong contextMultimodalAgnes 2.5 Pro Beta, Agents & tools: 64.4Agnes 2.5 Pro Beta, Long context: 66.2Agnes 2.5 Pro Beta, Multimodal: 57.7Claude Opus 5, Agents & tools: 63.8Claude Opus 5, Long context: 64.3Claude Opus 5, Multimodal: 67.2

Not drawn, measured for fewer than two of these models: Reasoning, Coding, Maths, Knowledge, Instruction following, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 10 benchmarks both have, Agnes 2.5 Pro Beta leads 1, Claude Opus 5 leads 9.

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureAgnes 2.5 Pro BetaClaude Opus 5 (max)
Blended price per 1M tokens–$10.00
Input / output per 1M– / –$5.00 / $25.00
Cached input per 1M–$0.500
Price per task: chat reply–$0.0095
Price per task: summarize a 30-page report–$0.075
Price per task: code edit–$0.068
Price per task: agentic coding session–$0.400
Price per task: structured extraction–$0.015
Agentic coding session, input mostly cached–$0.198
Cost per benchmark task (AA Index)–$11.82
Output tokens per task (AA Index)–118k
Of which reasoning–73k
Time per task (AA Index)–25 min
Output speed–80 tok/s
Time to first answer–48.5 s
Time to a complete answer, last measured 13 Nov 2026–191.6 s

Each model is compared at its best-ranked reasoning-effort setting. Agnes 2.5 Pro Beta. Claude Opus 5 (max) scores 65.0 and takes 49 s to its first answer token; Claude Opus 5 (high) scores 64.4 in 17 s, Claude Opus 5 scores 63.2 in 2 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

144 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherAgnes 2.5 Pro BetaClaude Opus 5 (max)
BenchLeader IndexBenchLeader–65.0
Agents & tools scoreBenchLeader64.463.8
Long context scoreBenchLeader66.264.3
Multimodal scoreBenchLeader57.767.2
Coding scoreBenchLeader–67.0
Human preference scoreBenchLeader–68.1
Knowledge scoreBenchLeader–65.2
Maths scoreBenchLeader–69.8
Reasoning scoreBenchLeader–66.1
Blended price $/MBenchLeader–$10.00
Output speedBenchLeader–80 tok/s
Time to first answerBenchLeader–48.5 s
Context windowBenchLeader1,000,000 tokens1,000,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub–93.9%
SimpleBenchSimpleBench–80.6%†
Arena Hard PromptsArena (LMArena)–1513
LiveBench 1.0 ReasoningLiveBench–91.2%
GPQA Diamond (AA)Artificial Analysis90.5%93.2%
Humanity's Last Exam (AA)Artificial Analysis37.5%54.9%
HLE-Diamond (AA)Artificial Analysis–44.8%
GPQA Diamond (Vals)Vals AI–93.4%†
ARC-AGI-1ARC Prize–97.5%
ARC-AGI-2ARC Prize–90.4%
ARC-AGI-3ARC Prize–30.2%†
CritPtArtificial Analysis15.7%29.1%
CritPt v2 hard subset (AA)Artificial Analysis–50.0%
MysteryMechanismVals AI–37.4%
HLE-Diamond (Scale)Scale AI SEAL–38.6%†
Arena ExpertArena (LMArena)–1530
Chess PuzzlesEpoch AI Benchmarking Hub–43.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub–59.0%
LMCAEpoch AI Benchmarking Hub–63.3%
DTBenchEpoch AI Benchmarking Hub–97.6%
ForecastBenchForecastBench–66.6%
BTF-3Epoch AI Benchmarking Hub–12.0%†
Coding
SciCodeSciCode–56.4%
WeirdMLWeirdML–91.8%
FrontierCodeCognition–53.4%
Show all 144 benchmarks
MetricPublisherAgnes 2.5 Pro BetaClaude Opus 5 (max)
Coding
Arena CodingArena (LMArena)–1528
Arena WebDevArena (LMArena)–1691
LiveBench 1.0 CodingLiveBench–81.5%
SciCode (AA)Artificial Analysis48.8%56.4%
LiveCodeBenchVals AI–89.0%
IOIVals AI–84.3%
SWE-bench (Vals)Vals AI–97.0%†
Code MigrationVals AI–57.5%
ProgramBenchVals AI–3.0%
Vibe Code Bench 1-100Vals AI–28.5%
Vibe Code Bench v1.1Vals AI–88.4%†
SWE Atlas v1.0: Codebase QnAScale AI SEAL–63.2%†
SWE Atlas v1.0: Test WritingScale AI SEAL–62.2%†
SWE-Bench Pro V2Scale AI SEAL–99.4%†
SWE-Bench Pro V2 HARDScale AI SEAL–98.0%†
MirrorCodeEpoch AI Benchmarking Hub–87.8%
DeepSWE v1.1Epoch AI Benchmarking Hub–73.7%
CursorBenchCursor–46.6%
ALE-BenchEpoch AI Benchmarking Hub–2164.6†
FrontierSWEEpoch AI Benchmarking Hub–52.0%
WeirdML v3WeirdML–19.0%†
Terminal-Bench 4.0 (AA)Artificial Analysis–49.0%
Terminal-Bench 2.1 (AA)Artificial Analysis69.7%89.1%
Startrise FrontendStartrise–82.3%†
GameBench 2 OverallDuelLab GameBench 2–76.5†
GameBench 2 by reasoning settingDuelLab GameBench 2–84.8†
Design Arena WebsiteDesign Arena–1304†
FrontierCode 2.0 (AA)Artificial Analysis–31.1%
Agents & tools
Terminal-BenchTerminal-Bench–52.1%
OSWorld-Verified 2.0OSWorld–31.4%
APEX-AgentsMercor–65.8%
Arena AgentArena (LMArena)–7.2
LiveBench Agentic CodingLiveBench–65.2%
Terminal-Bench 2.1 (Vals)Vals AI–84.6%†
MCP AtlasScale AI SEAL–85.8%†
HiL-BenchScale AI SEAL–57.0%†
τ³-bench Bankingτ²-bench–48.7%
GDPval-AA v2.1, normalised scoreArtificial Analysis41.5%–
GDPval-AA v2.1Artificial Analysis13351729
τ³-Banking (AA)Artificial Analysis35.7%42.1%
Analyst Agent (AA)Artificial Analysis–53.8%
CUA-benchVals AI–9.0%
CyberBenchVals AI–65.4%
Finance Agent v2Vals AI–58.6%
Harvey's Legal Agent Benchmark v1Vals AI–6.7%
Legal Research BenchVals AI–55.3%
SkillsBenchVals AI–60.4%
SREBenchVals AI–12.2%
Tax Agent BenchVals AI–47.1%
Terminal-Bench 4.0 (Vals)Vals AI–53.5%
Terminal-Bench ScienceVals AI–27.1%
Time Horizon Index: KSPVals AI–18.8%
Arena SearchArena (LMArena)–1213†
Arena Agent Task CompletionArena (LMArena)–10.2
BALROGBALROG–63.4%
PostTrainBenchEpoch AI Benchmarking Hub–35.7%†
GBAEvalEpoch AI Benchmarking Hub–79.6%†
Vending-Bench 2Andon Labs–11181.9†
AutomationBenchArtificial Analysis–56.6%
GDP.pdf (AA)Artificial Analysis–21.6%
EnterpriseOps-GymArtificial Analysis–47.5%
AA-Briefcase v1.1Artificial Analysis–1654
Design Arena AgenticDesign Arena–1270†
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–28.6%
DeepSec-Bench (AA)Artificial Analysis–25.9%
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub–85.6%
FrontierMath Tier 4Epoch AI Benchmarking Hub–73.2%
OTIS Mock AIMEEpoch AI Benchmarking Hub–98.9%
ProofBenchVals AI–99.0%
LiveBench MathematicsLiveBench–95.7%
Arena MathsArena (LMArena)–1515
FrontierMath ErdősEpoch AI Benchmarking Hub–0.0%
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub–59.9%
LiveBench 1.0 Data AnalysisLiveBench–74.5%
AA-Omniscience v1.1Artificial Analysis–37.6
MMLU-ProVals AI–91.6%
LegalBenchVals AI–87.0%
CorpFinVals AI–73.2%†
TaxEvalVals AI–75.1%†
BioMysteryBenchVals AI–79.3%
Excel Modeling BenchmarkVals AI–73.6%
MedCodeVals AI–63.6%
MedScribeVals AI–91.0%
Public Benefits Bench v1.1Vals AI–76.9%
DrugDiscoveryBenchScale AI SEAL–53.7%
EBR-benchEpoch AI Benchmarking Hub–45.7%
GDP.pdfEpoch AI Benchmarking Hub–24.0%
AA-Omniscience v1.1: accuracyArtificial Analysis–60.9%
AA-Omniscience v1.1: non-hallucinationArtificial Analysis–40.6%
FACTS ParametricGoogle–48.8%†
Instruction following
LiveBench LanguageLiveBench–88.7%
LiveBench Instruction FollowingLiveBench–63.8%
Arena Instruction FollowingArena (LMArena)–1494
Human preference
Arena TextArena (LMArena)–1489
EQ-Bench 4EQ-Bench–1365†
EQ-Bench Creative Writing v3EQ-Bench–2135†
Arena Creative WritingArena (LMArena)–1473
Arena Multi-turnArena (LMArena)–1486
Arena Longer QueriesArena (LMArena)–1502
Multimodal
Arena VisionArena (LMArena)–1318†
MMMU-ProArtificial Analysis75.4%84.7%
MMMU-Pro (Vals)Vals AI–89.9%
MortgageTaxVals AI–72.1%†
Humanity's Sixth SenseScale AI SEAL–30.5%
Blueprint-Bench 2Epoch AI Benchmarking Hub–30.4%†
Furniture AssemblyEpoch AI Benchmarking Hub–60.8%
Long context
AA-LCR v1.1Artificial Analysis83.0%79.3%
Arena DocumentArena (LMArena)–1486†
MLCRArtificial Analysis–11.1%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub–164.7†
LiveBench 1.0LiveBench–80.1%
AA Intelligence Index v5.0.1Artificial Analysis–44.2
AA Intelligence Index v4.3.2Artificial Analysis35.250.8
AA Progress Index v1Artificial Analysis299.1333.7
Vals RSI IndexVals AI–33.0%
Vals Science IndexVals AI–47.9%
Vals Multimodal IndexVals AI–73.9%†
Safety & honesty
FORTRESSScale AI SEAL–16.8%†
DistressBenchScale AI SEAL–70.2%†

Data as of 2026-11-16. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261111-7b598bb13de4 (https://benchmarks.duellab.org/releases/gb2-20261111-7b598bb13de4/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • Claude Opus 5 (max): 25 new results (LiveCodeBench, MMLU-Pro, IOI…).
  • Claude Opus 5 (max): 1 new result (GDPval-AA v2.1).
  • Claude Opus 5 (max): 1 new result (MirrorCode).
  • Claude Opus 5 (max): BenchLeader Index 65.5 → 65.0.
  • Claude Opus 5 (max): 7 new results (AA Intelligence Index v5.0.1, HLE-Diamond (AA), AA-Omniscience v1.1…).
  • Claude Opus 5 (max): 1 new result (MirrorCode).
  • Claude Opus 5 (max): 1 score revision.
  • Claude Opus 5 (max): BenchLeader Index 66.3 → 65.5.
  • Agnes 2.5 Pro Beta: 1 new result (AA Progress Index v1).
  • Claude Opus 5 (max): 1 new result (AA Progress Index v1).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Agnes 2.5 Pro Beta vs Claude Opus 5: questions

Agnes 2.5 Pro Beta vs Claude Opus 5: which is cheaper, and will that change?
Agnes 2.5 Pro Beta is cheaper today: $0.150 against $10.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is Agnes 2.5 Pro Beta or Claude Opus 5 better for agents and tool use?
They are level in agentic tasks (64 vs 64 on the category index). On τ³-Banking (AA), the top shared agents & tools benchmark, it is 35.7% for Agnes 2.5 Pro Beta against 42.1% for Claude Opus 5.
Which is better for long documents?
Agnes 2.5 Pro Beta scores higher on long-context benchmarks (66 vs 64). Both accept 1,000,000 tokens of context.
Do independent benchmarks agree on Agnes 2.5 Pro Beta vs Claude Opus 5?
Across the 10 benchmarks both have, Agnes 2.5 Pro Beta leads 1, Claude Opus 5 leads 9.
When was Agnes 2.5 Pro Beta released?
Agnes 2.5 Pro Beta was released on 26 Aug 2026.