BenchLeader

Claude Opus 5 vs GPT-5.4 Pro

Full profiles: Claude Opus 5 (Anthropic) and GPT-5.4 Pro (OpenAI): every benchmark, price and rank.

Updated · Data from 11 sources

As of 25 Oct 2026, Claude Opus 5 (max) is the better pick for most workloads: it leads on quality (68.8 vs 63.3 on the BenchLeader Index) and costs 6.8× less. Pick Claude Opus 5 for reasoning (74 vs 73); pick GPT-5.4 Pro for knowledge (74 vs 72).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
ReasoningClaude Opus 574 vs 73 category scoreMedium
KnowledgeGPT-5.4 Pro74 vs 72 category scoreMedium
Images and other mediaGPT-5.4 Pro70 vs 68 category scoreMedium
Chat quality (human preference)–Only Claude Opus 5 has an Arena rating (69 category score)Not comparable
Lowest costClaude Opus 5$10.00 vs $67.50 per 1M blended; agentic coding session $0.400 vs $2.52–
Fastest first answerGPT-5.4 Pro6.1 s (GPT-5.4 Pro) vs 24.1 s (Claude Opus 5 (max)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • Claude Opus 5 (max) leads on quality: 68.8 vs 63.3.
  • Claude Opus 5 (max) is stronger in agents & tools, coding, composite, human preference, long context, maths, reasoning.
  • GPT-5.4 Pro is stronger in knowledge, multimodal, instruction following.
  • Claude Opus 5 (max) is 6.8× cheaper ($10.00 vs $67.50 per 1M blended).
  • Claude Opus 5 (max) streams 8.1× faster (57 vs 7 tokens per second).

At a glance

SpecClaude Opus 5GPT-5.4 Pro
DeveloperAnthropicOpenAI
Released24 Jul 20264 Mar 2026
Context window (tokens)1,000,0001,050,000
Compared atClaude Opus 5 (max)GPT-5.4 Pro
Open weightsNoNo
Price in / out / cached input per 1M$5.00 / $25.00 / $0.500$30.00 / $180.00 / –

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryClaude Opus 5 (max)GPT-5.4 ProLeader
Reasoning74.172.5Claude Opus 5
Coding70.2–not comparable
Agents & tools64.3–not comparable
Maths70.6–not comparable
Knowledge71.673.6GPT-5.4 Pro
Instruction following–63.8not comparable
Human preference68.5–not comparable
Multimodal67.969.8GPT-5.4 Pro
Long context64.7–not comparable
Composite86.3–not comparable

Where sources disagree

Across the 0 benchmarks both have, Claude Opus 5 leads 0, GPT-5.4 Pro leads 0. Every overall index that rates both puts Claude Opus 5 ahead.

Overall indexClaude Opus 5 (max)GPT-5.4 ProLeader
BenchLeader Index68.863.3Claude Opus 5

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureClaude Opus 5 (max)GPT-5.4 Pro
Blended price per 1M tokens$10.00$67.50
Input / output per 1M$5.00 / $25.00$30.00 / $180.00
Cached input per 1M$0.500–
Price per task: chat reply$0.0095$0.066
Price per task: summarize a 30-page report$0.075$0.468
Price per task: code edit$0.068$0.450
Price per task: agentic coding session$0.400$2.52
Price per task: structured extraction$0.015$0.096
Cost to run a full benchmark suite$5.86–
Output speed57 tok/s7 tok/s
Time to first answer24.1 s6.1 s
Time to a complete answer32.9 s–

Each model is compared at its best-ranked reasoning-effort setting. Claude Opus 5 (max) scores 68.8 and takes 24 s to its first answer token; Claude Opus 5 (high) scores 67.9 in 10 s, Claude Opus 5 (xhigh) scores 67.4 in 25 s. GPT-5.4 Pro scores 63.3 and takes 6 s to its first answer token; GPT-5.4 Pro (xhigh) scores 61.9 in 6 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

136 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherClaude Opus 5 (max)GPT-5.4 Pro
BenchLeader IndexBenchLeader68.863.3
Agents & tools scoreBenchLeader64.3–
Coding scoreBenchLeader70.2–
Composite scoreBenchLeader86.3–
Human preference scoreBenchLeader68.5–
Knowledge scoreBenchLeader71.673.6
Long context scoreBenchLeader64.7–
Maths scoreBenchLeader70.6–
Multimodal scoreBenchLeader67.969.8
Reasoning scoreBenchLeader74.172.5
Instruction following scoreBenchLeader–63.8
Blended price $/MBenchLeader$10.00$67.50
Output speedBenchLeader57 tok/s7 tok/s
Time to first answerBenchLeader24.1 s6.1 s
Context windowBenchLeader1,000,000 tokens1,050,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub93.9%94.6%†
Humanity's Last ExamScale AI / CAIS–44.3%
SimpleBenchSimpleBench80.6%†74.1%
Arena Hard PromptsArena (LMArena)1515–
LiveBench 2.0 ReasoningLiveBench91.2%†–
LiveBench 1.0 ReasoningLiveBench91.2%–
GPQA Diamond (AA)Artificial Analysis93.2%–
Humanity's Last Exam (AA)Artificial Analysis54.9%–
GPQA Diamond (Vals)Vals AI93.4%†–
ARC-AGI-1ARC Prize97.5%94.5%†
ARC-AGI-2ARC Prize90.4%83.3%†
ARC-AGI-3ARC Prize30.2%†–
CritPtArtificial Analysis29.1%30.0%†
MysteryMechanismVals AI37.4%†–
Chess PuzzlesEpoch AI Benchmarking Hub43.0%59.0%†
Mystery Game PuzzlesEpoch AI Benchmarking Hub59.0%–
LMCAEpoch AI Benchmarking Hub63.3%–
DTBenchEpoch AI Benchmarking Hub97.6%–
ForecastBenchForecastBench66.5%–
BTF-3Epoch AI Benchmarking Hub12.0%†–
Coding
SciCodeSciCode56.4%–
WeirdMLWeirdML91.8%57.4%†
FrontierCodeCognition53.4%–
Arena CodingArena (LMArena)1528–
Arena WebDevArena (LMArena)1691–
Show all 136 benchmarks
MetricPublisherClaude Opus 5 (max)GPT-5.4 Pro
Coding
LiveBench 2.0 CodingLiveBench90.8%†–
LiveBench 1.0 CodingLiveBench81.5%–
LiveCodeBenchVals AI89.0%†–
IOIVals AI84.3%†–
SWE-bench (Vals)Vals AI97.0%†–
Code MigrationVals AI57.5%†–
ProgramBenchVals AI3.0%†–
Vibe Code Bench 1-100Vals AI28.5%†–
Vibe Code Bench v1.1Vals AI88.4%†–
SWE Atlas: Codebase QnAScale AI SEAL63.2%†–
SWE Atlas: Test WritingScale AI SEAL62.2%†–
DeepSWE v1.1Epoch AI Benchmarking Hub73.7%–
CursorBenchCursor46.6%–
ALE-BenchEpoch AI Benchmarking Hub2164.6†–
FrontierSWEEpoch AI Benchmarking Hub52.0%–
Terminal-Bench 4.0 (AA)Artificial Analysis49.0%–
Terminal-Bench 2.1 (AA)Artificial Analysis89.1%–
Startrise FrontendStartrise82.3%†–
Agents & tools
Terminal-BenchTerminal-Bench51.8%–
OSWorld-Verified 2.0OSWorld31.4%–
APEX-AgentsMercor65.8%–
Arena AgentArena (LMArena)8.2–
LiveBench Long AgenticLiveBench62.1%†–
LiveBench BrowserLiveBench84.0%†–
LiveBench Agentic CodingLiveBench65.2%–
Terminal-Bench 2.1 (Vals)Vals AI84.6%†–
MCP AtlasScale AI SEAL85.8%†–
HiL-BenchScale AI SEAL57.0%†–
τ³-bench Bankingτ²-bench48.7%–
τ³-Banking (AA)Artificial Analysis42.1%–
Analyst Agent (AA)Artificial Analysis53.8%–
CUA-benchVals AI9.0%–
CyberBenchVals AI65.4%†–
Finance Agent v2Vals AI58.6%†–
Harvey's Legal Agent Benchmark v1Vals AI6.7%†–
Legal Research BenchVals AI55.3%†–
SkillsBenchVals AI60.4%†–
SREBenchVals AI12.2%†–
Tax Agent BenchVals AI45.5%†–
Terminal-Bench 4.0 (Vals)Vals AI53.5%†–
Terminal-Bench ScienceVals AI27.1%†–
Time Horizon Index: KSPVals AI18.8%†–
Arena SearchArena (LMArena)1214†–
BALROGBALROG63.4%–
PostTrainBenchEpoch AI Benchmarking Hub35.0%†–
GBAEvalEpoch AI Benchmarking Hub79.6%†–
Vending-Bench 2Andon Labs11181.9†–
AutomationBenchArtificial Analysis56.6%–
GDP.pdf (AA)Artificial Analysis21.6%–
EnterpriseOps-GymArtificial Analysis47.5%–
AA-Briefcase v1.1Artificial Analysis1657–
Terminal-Bench-Science 0.1 (AA)Artificial Analysis28.6%–
DeepSec-Bench (AA)Artificial Analysis25.9%–
FACTS SearchGoogle85.3%†–
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub85.6%82.5%†
FrontierMath Tier 4Epoch AI Benchmarking Hub73.2%58.5%†
OTIS Mock AIMEEpoch AI Benchmarking Hub98.9%–
ProofBenchVals AI99.0%–
LiveBench MathematicsLiveBench95.7%–
MathArena ApexMathArena–69.8%†
Arena MathsArena (LMArena)1517–
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub59.9%46.3%†
LiveBench 2.0 Data AnalysisLiveBench74.6%†–
LiveBench ResearchLiveBench88.9%†–
LiveBench 1.0 Data AnalysisLiveBench74.5%–
AA-OmniscienceArtificial Analysis37.1–
MMLU-ProVals AI91.6%†–
LegalBenchVals AI87.0%†–
CorpFinVals AI73.2%†–
TaxEvalVals AI75.1%†–
MultiNRCScale AI SEAL–62.3%
BioMysteryBenchVals AI79.3%†–
Excel Modeling BenchmarkVals AI73.6%†–
MedCodeVals AI63.6%†–
MedScribeVals AI91.0%†–
Public Benefits Bench v1.1Vals AI76.9%†–
DrugDiscoveryBenchScale AI SEAL53.7%–
EBR-benchEpoch AI Benchmarking Hub45.7%–
GDP.pdfEpoch AI Benchmarking Hub24.0%–
AA-Omniscience: accuracyArtificial Analysis60.9%–
AA-Omniscience: non-hallucinationArtificial Analysis39.2%–
Instruction following
LiveBench LanguageLiveBench88.7%–
LiveBench Instruction FollowingLiveBench63.8%–
MultiChallengeScale AI SEAL–69.2%
TutorBenchScale AI SEAL–56.6%
Arena Instruction FollowingArena (LMArena)1495–
Human preference
Arena TextArena (LMArena)1491–
EQ-Bench 4EQ-Bench1360†–
Arena Creative WritingArena (LMArena)1474–
Arena Multi-turnArena (LMArena)1487–
Arena Longer QueriesArena (LMArena)1503–
Multimodal
Arena VisionArena (LMArena)1320†–
LiveBench DesignLiveBench83.0%†–
MMMU-ProArtificial Analysis84.7%–
VISTAScale AI SEAL–53.9%
MMMU-Pro (Vals)Vals AI89.9%†–
MortgageTaxVals AI72.1%†–
SAGEVals AI49.4%†–
Blueprint-Bench 2Epoch AI Benchmarking Hub30.4%†–
Long context
AA-LCRArtificial Analysis79.3%–
Arena DocumentArena (LMArena)1490†–
MLCRArtificial Analysis11.1%–
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub163.9†159.6
LiveBench 2.0LiveBench82.1%†–
LiveBench 1.0LiveBench80.1%–
AA Intelligence Index v4.3.2Artificial Analysis50.8–
Vals RSI IndexVals AI33.0%–
Vals Science IndexVals AI47.9%†–
Vals Multimodal IndexVals AI73.9%†–
Safety & honesty
FORTRESSScale AI SEAL16.8%†14.8%
MASKScale AI SEAL–91.7%

Data as of 2026-10-25. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Claude Opus 5 (max): 1 new result (Vals RSI Index).
  • Claude Opus 5 (max): 1 score revision.
  • GPT-5.4 Pro: 1 score revision.
  • Claude Opus 5 (max): 1 new result (ForecastBench); 1 score revision.
  • Claude Opus 5 (max): BenchLeader Index 68.3 → 68.9.
  • Claude Opus 5 (max): 4 new results (GDPval-AA v2.1, AA-Omniscience: accuracy, AA-Omniscience: non-hallucination…).
  • Claude Opus 5 (max): 1 score revision.
  • Claude Opus 5 (max): 2 score revisions.
  • Claude Opus 5 (max): 2 new results (Terminal-Bench-Science 0.1 (AA), DeepSec-Bench (AA)).
  • Claude Opus 5 (max): 1 new result (DrugDiscoveryBench).

Rankings: Best LLM overall · Best LLM for coding · Best LLM for agents · Best cheap LLMs

Claude Opus 5 vs GPT-5.4 Pro: questions

Is Claude Opus 5 better than GPT-5.4 Pro?
Claude Opus 5 (max) leads on quality: 68.8 vs 63.3. The BenchLeader Index combines every independent quality benchmark; Claude Opus 5 (max) is ahead overall as of 2026-10-25, but check the category scores for your use.
Which is cheaper, Claude Opus 5 or GPT-5.4 Pro, and will that change?
Claude Opus 5 is cheaper today: $10.00 against $67.50 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Which is better for long documents?
Both take about 1.1M tokens: Claude Opus 5 1,000,000, GPT-5.4 Pro 1,050,000.
Which has lower latency?
GPT-5.4 Pro answers first: 6.1 s against 24.1 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Which is faster, Claude Opus 5 or GPT-5.4 Pro?
Claude Opus 5 streams faster: 57 against 7 output tokens per second.
When was Claude Opus 5 released?
Claude Opus 5 was released on 24 Jul 2026.