BenchLeader

Claude 3.7 Sonnet

Reasoning effort

Claude 3.7 Sonnet is an Anthropic proprietary reasoning model, released 24 Feb 2025. Its best configuration (thinking reasoning effort) ranks #352 of 785 on the BenchLeader Index at 51.0 ±2.8, in the upper half. The ± is the point: 301 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in human preference (56) and lowest in instruction following (45). It has been measured at 3 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 22 Oct 2026.

Blended price
–
Output speed
–
First answer
–
Context
200k
Full answer
–
Cost per run
–
Released
24 Feb 2025
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index51
  2. Reasoning47
  3. Coding48
  4. Agents & tools52
  5. Maths53
  6. Knowledge55
  7. Instruction following45
  8. Human preference56
  9. Multimodal54
  10. Composite49

Versions

Anthropic has shipped 10 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.

ModelReleasedIndexRank
Claude Sonnet 5.5max28 Sept 202669.4#10
Claude Sonnet 5high30 Jun 202660.1#116
Claude Sonnet 4.617 Feb 202657.1#185
Claude Sonnet 4.5high29 Sept 202558.1#161
Claude Sonnet 4thinking22 May 202553.2#293
Claude 3.7 Sonnetthinkingthis page24 Feb 202551.0#352
Claude 3.5 Sonnet22 Oct 202446.3#490
Claude 3 Sonnet29 Feb 202438.0#721
Claude 37 Sonnetthinking–––
Claude Sonnet 5.0max–––

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning49.5#394––$0.0057Agents & tools 52 · Coding 59 · Composite 47 · Instruction following 46 · Knowledge 57 · Long context 50 · Multimodal 43 · Reasoning 41
thinkingbest51.0#352–––Agents & tools 52 · Coding 48 · Composite 49 · Human preference 56 · Instruction following 45 · Knowledge 55 · Maths 53 · Multimodal 54 · Reasoning 47
not stated50.0#382–––Agents & tools 44 · Coding 48 · Human preference 54 · Instruction following 54 · Knowledge 52 · Long context 48 · Maths 50 · Multimodal 51 · Reasoning 49

How its index has moved

8 Sept 2026 to 21 Oct 2026
475155
  • thinking
  • not stated
  • no reasoning

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoningthinkingnot statedSourceTrend
GPQA Diamondeffort not stated––79.7%#127Epoch AI Benchmarking Hub
Humanity's Last Exameffort not stated––8.0%#35Scale AI / CAIS
SimpleBencheffort not stated––46.4%#51SimpleBench
Arena Hard Prompts–1418#1521399#174Arena (LMArena)
GPQA Diamond (AA)not in index65.6%#34177.2%#223–Artificial Analysis
Humanity's Last Exam (AA)not in index4.2%#5359.7%#331–Artificial Analysis
GPQA Diamond (Vals)not in index–75.3%#7767.4%#96Vals AI
GPQA Diamond (HELM)not in indexeffort not stated––60.8%#26HELM Capabilities
CritPt0.0%#3150.9%#237–Artificial Analysis
ForecastBenchnot in indexeffort not stated––64.0%#37ForecastBench

Coding

Benchmarkno reasoningthinkingnot statedSourceTrend
SWE-bench Verified (Epoch)effort not stated––61.0%#29Epoch AI Benchmarking Hub
GSO-Bencheffort not stated––3.8%#30GSO-Bench
Arena Coding–1452#1431431#174Arena (LMArena)
LiveCodeBench–60.4%#10156.7%#106Vals AI
Aider Polyglot60.4%#14–64.9%#10Aider polyglot leaderboard
SWE-bench Verified (bash only)effort not stated––52.8%#33SWE-bench
SWE-bench Verified (any scaffold)not in indexeffort not stated––66.4%#18SWE-bench
CadEvalnot in indexeffort not stated––54.0%#5Epoch AI Benchmarking Hub

Agents & tools

Benchmarkno reasoningthinkingnot statedSourceTrend
Cybencheffort not stated––20.0%#11Cybench
Terminal-Bench Hard21.2%#15821.2%#158–Artificial Analysis
τ²-Bench Telecom (AA)not in index50.0%#19754.7%#186–Artificial Analysis
DeepResearch Benchnot in indexeffort not stated––43.6%#32DeepResearch Bench
TheAgentCompanynot in indexeffort not stated––30.9%#4TheAgentCompany
METR Time Horizonsnot in indexeffort not stated––60.0%#20METR
BrowseCompnot in indexeffort not stated––0.9%#21OpenAI

Maths

Benchmarkthinkingnot statedSourceTrend
OTIS Mock AIMEeffort not stated–57.8%#167Epoch AI Benchmarking Hub
MATH Level 5effort not stated–91.2%#19Epoch AI Benchmarking Hub
AIME (Vals)44.6%#6122.3%#76Vals AI
MGSM93.0%#1292.4%#19Vals AI
Omni-MATH (HELM)effort not stated–33.0%#38HELM Capabilities
MATH 500not in index91.6%#2176.8%#41Vals AI
Arena Maths1386#1681363#187Arena (LMArena)

Knowledge

Benchmarkno reasoningthinkingnot statedSourceTrend
AA-Omniscience-9.7#188-0.7#141–Artificial Analysis
MMLU-Pro–82.7%#7380.7%#81Vals AI
LegalBench–82.5%#6780.0%#88Vals AI
CorpFin–60.4%#68–Vals AI
TaxEval–74.0%#4172.4%#61Vals AI
MedQA–90.2%#46–Vals AI
MultiNRC–27.8%#26–Scale AI SEAL
MMLU-Pro (HELM)not in indexeffort not stated––78.4%#24HELM Capabilities
AA-Omniscience: accuracynot in index28.2%#20028.0%#201–Artificial Analysis
AA-Omniscience: non-hallucinationnot in index47.2%#13560.0%#77–Artificial Analysis

Instruction following

Benchmarkno reasoningthinkingnot statedSourceTrend
IFBench44.0%#21848.3%#184–Artificial Analysis
MultiChallenge–51.6%#25–Scale AI SEAL
IFEval (HELM)effort not stated––83.4%#32HELM Capabilities
WildBench (HELM)effort not stated––81.4%#26HELM Capabilities
Arena Instruction Followingnot in index–1411#1221385#155Arena (LMArena)

Human preference

Benchmarkthinkingnot statedSourceTrend
Arena Text1388#1641373#182Arena (LMArena)
Arena Creative Writingnot in index1393#1151377#138Arena (LMArena)
Arena Multi-turnnot in index1400#1531399#154Arena (LMArena)
Arena Longer Queriesnot in index1429#1211412#144Arena (LMArena)
Lech Mazur Creative Writingnot in indexeffort not stated–81.1%#15Lech Mazur

Multimodal

Benchmarkno reasoningthinkingnot statedSourceTrend
Arena Vision–1169#1071151#117Arena (LMArena)
MMMU-Pro60.1%#212––Artificial Analysis
VISTA–48.2%#1643.0%#35Scale AI SEAL
MMMU (validation)effort not stated––75.0%#14MMMU
MMMU-Pro (Vals)not in index–75.1%#5471.5%#66Vals AI
MortgageTaxnot in index–66.8%#3168.7%#12Vals AI
GeoBenchnot in indexeffort not stated––68.0%#13GeoBench
VPCTnot in indexeffort not stated––39.0%#19Epoch AI Benchmarking Hub
SpatialViz-Benchnot in indexeffort not stated––33.9%#5Epoch AI Benchmarking Hub

Long context

Benchmarkno reasoningnot statedSourceTrend
Fiction.LiveBench 120keffort not stated–53.1%#20Fiction.live
AA-LCR51.7%#319–Artificial Analysis

Composite

Benchmarkno reasoningthinkingnot statedSourceTrend
Epoch Capabilities Indexnot in indexeffort not stated––141.0#109Epoch AI Benchmarking Hub
AA Intelligence Index v4.3.215.3#28517.7#261–Artificial Analysis
HELM Capabilities meannot in indexeffort not stated––67.4%#28HELM Capabilities

Safety & honesty

Benchmarkthinkingnot statedSourceTrend
FORTRESSnot in indexeffort not stated–38.0%#21Scale AI SEAL
MASKnot in index82.1%#2372.3%#30Scale AI SEAL

More from Anthropic

New this month

See also

Questions people ask

What are Claude 3.7 Sonnet's benchmark scores?
As of 25 Oct 2026, Claude 3.7 Sonnet (thinking effort) scores 51.0 ±2.8 on the BenchLeader Index, strongest in human preference (56) and weakest in instruction following (45). That rests on 21 independent benchmark results, and every score on this page links to its publisher.
How does Claude 3.7 Sonnet rank?
Claude 3.7 Sonnet (thinking effort) is #352 of 785 ranked configurations on 25 Oct 2026. 301 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Opus 5.5 (max effort) at 72.6.
When was Claude 3.7 Sonnet released?
Anthropic released Claude 3.7 Sonnet on 24 Feb 2025. BenchLeader has results for it at 3 reasoning-effort settings.

Data as of 25 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “Claude 3.7 Sonnet: benchmarks, pricing, speed and rank”, data as of 25 Oct 2026, https://www.benchleader.com/models/claude-3-7-sonnet.