BenchLeader

GPT-4.1

Reasoning effort

GPT-4.1 is an OpenAI proprietary model, released 14 Apr 2025. Its best configuration ranks #428 of 785 on the BenchLeader Index at 48.3 ±4.0, in the lower half. The ± is the point: 303 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in human preference (59) and lowest in knowledge (39). At $3.50 per million tokens blended it is among the most expensive ranked models. Output speed of 161 tokens per second puts it in the fastest quarter, with a first answer in 0.9 s. It has been measured at 2 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 22 Oct 2026.

Blended price
$3.50/M
$2.00 in · $8.00 out
Output speed
161 tok/s
measured by Artificial Analysis
First answer
0.89 s
first token 1.01 s
Context
1.0M
Full answer
4.00 s
median, reasoning included
Cost per run
–
Released
14 Apr 2025
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index48
  2. Reasoning39
  3. Coding43
  4. Agents & tools58
  5. Maths48
  6. Knowledge39
  7. Instruction following45
  8. Human preference59
  9. Multimodal51
  10. Long context57
  11. Composite44

Versions

OpenAI has shipped 13 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.

ModelReleasedIndexRank
GPT-5.69 Jul 2026––
GPT-5.5xhigh23 Apr 202666.1#35
GPT-5.4xhigh5 Mar 202664.7#45
GPT-5.2xhigh11 Dec 202560.7#104
GPT-5.1high12 Nov 202557.7#170
GPT-5high7 Aug 202557.9#166
GPT-4.1this page14 Apr 202548.3#428
GPT-4.527 Feb 202549.7#388
GPT 4 012525 Jan 2024––
GPT-4 11066 Nov 2023––
GPT 4 061313 Jun 202339.7#677
GPT-414 Mar 202342.4#596
GPT-3.5–––

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
high46.7#477161 tok/s0.89 s$0.0032Coding 38 · Knowledge 55 · Maths 43
not statedbest48.3#428161 tok/s0.89 s$0.0032Agents & tools 58 · Coding 43 · Composite 44 · Human preference 59 · Instruction following 45 · Knowledge 39 · Long context 57 · Maths 48 · Multimodal 51 · Reasoning 39

How its index has moved

8 Sept 2026 to 21 Oct 2026
424854
  • not stated
  • high

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkhighnot statedSourceTrend
GPQA Diamondeffort not stated–66.9%#177Epoch AI Benchmarking Hub
Humanity's Last Exameffort not stated–5.4%#42Scale AI / CAIS
SimpleBencheffort not stated–27.0%#72SimpleBench
Arena Hard Promptseffort not stated–1432#134Arena (LMArena)
GPQA Diamond (AA)not in indexeffort not stated–66.6%#330Artificial Analysis
Humanity's Last Exam (AA)not in indexeffort not stated–4.2%#530Artificial Analysis
GPQA Diamond (Vals)not in index65.4%#97–Vals AI
Kagi LLM Benchmarkeffort not stated–52.3%#73Kagi LLM Benchmark
GPQA Diamond (HELM)not in indexeffort not stated–65.9%#18HELM Capabilities
ARC-AGI-1effort not stated–5.5%#243ARC Prize
ARC-AGI-2effort not stated–0.4%#239ARC Prize
CritPteffort not stated–0.0%#315Artificial Analysis
Chess Puzzlesnot in indexeffort not stated–3.0%#135Epoch AI Benchmarking Hub
LMCAnot in indexeffort not stated–25.6%#148Epoch AI Benchmarking Hub
DTBenchnot in indexeffort not stated–68.3%#161Epoch AI Benchmarking Hub
ForecastBenchnot in indexeffort not stated–62.3%#57ForecastBench

Coding

Benchmarkhighnot statedSourceTrend
SWE-bench Verified (Epoch)effort not stated–48.5%#32Epoch AI Benchmarking Hub
WeirdMLeffort not stated–39.0%#109WeirdML
Arena Codingeffort not stated–1456#140Arena (LMArena)
LiveCodeBench54.7%#108–Vals AI
Aider Polygloteffort not stated–52.4%#24Aider polyglot leaderboard
SWE-bench Verified (bash only)effort not stated–39.6%#36SWE-bench
SWE-bench Verified (any scaffold)not in indexeffort not stated–39.6%#47SWE-bench
CadEvalnot in indexeffort not stated–42.0%#8Epoch AI Benchmarking Hub
ALE-Benchnot in indexeffort not stated–558.1#102Epoch AI Benchmarking Hub

Agents & tools

Benchmarkhighnot statedSourceTrend
Terminal-Bench Hardeffort not stated–13.6%#201Artificial Analysis
τ²-Bench Telecom (AA)not in indexeffort not stated–47.1%#203Artificial Analysis
BFCL Overalleffort not stated–54.0%#18Berkeley Function Calling Leaderboard
Terminal-Bench 2.0 (Vals)not in index14.6%#60–Vals AI
BrowseComp-Plusnot in indexeffort not stated–15.3%#13BrowseComp-Plus
BrowseCompnot in indexeffort not stated–3.5%#6OpenAI

Maths

Benchmarkhighnot statedSourceTrend
FrontierMath Tiers 1–3effort not stated–6.0%#109Epoch AI Benchmarking Hub
OTIS Mock AIMEeffort not stated–38.3%#199Epoch AI Benchmarking Hub
MATH Level 5effort not stated–83.0%#31Epoch AI Benchmarking Hub
AIME (Vals)39.6%#67–Vals AI
MGSM87.7%#55–Vals AI
Omni-MATH (HELM)effort not stated–47.1%#21HELM Capabilities
MATH 500not in index87.2%#31–Vals AI
Arena Mathseffort not stated–1375#177Arena (LMArena)

Knowledge

Benchmarkhighnot statedSourceTrend
SimpleQA Verifiedeffort not stated–31.1%#65Epoch AI Benchmarking Hub
AA-Omniscienceeffort not stated–-39.6#321Artificial Analysis
MMLU-Pro80.5%#83–Vals AI
LegalBench83.1%#58–Vals AI
CorpFin63.0%#46–Vals AI
TaxEval75.1%#23–Vals AI
MedQA91.2%#39–Vals AI
PRBench Financeeffort not stated–34.3%#34Scale AI SEAL
PRBench Legaleffort not stated–36.5%#38Scale AI SEAL
MultiNRCeffort not stated–21.2%#33Scale AI SEAL
MMLU-Pro (HELM)not in indexeffort not stated–81.1%#16HELM Capabilities
CaseLaw v2not in index69.9%#3–Vals AI
AA-Omniscience: accuracynot in indexeffort not stated–27.8%#202Artificial Analysis
AA-Omniscience: non-hallucinationnot in indexeffort not stated–6.7%#499Artificial Analysis

Human preference

Benchmarknot statedSourceTrend
Arena Text1415#132Arena (LMArena)
Arena Creative Writingnot in index1403#103Arena (LMArena)
Arena Multi-turnnot in index1430#114Arena (LMArena)
Arena Longer Queriesnot in index1426#126Arena (LMArena)

Multimodal

Benchmarkhighnot statedSourceTrend
Arena Visioneffort not stated–1210#85Arena (LMArena)
MMMU-Proeffort not stated–61.2%#207Artificial Analysis
VISTAeffort not stated–45.3%#26Scale AI SEAL
MMMU-Pro (Vals)not in index72.4%#62–Vals AI
MortgageTaxnot in index65.9%#37–Vals AI
VTBnot in indexeffort not stated–5.5%#13Scale AI SEAL
GeoBenchnot in indexeffort not stated–72.0%#11GeoBench

Long context

Benchmarknot statedSourceTrend
Fiction.LiveBench 120k62.5%#13Fiction.live
AA-LCR68.3%#235Artificial Analysis

Safety & honesty

Benchmarknot statedSourceTrend
FORTRESSnot in index53.0%#11Scale AI SEAL
MASKnot in indexpossible contamination51.1%#48Scale AI SEAL

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Azure194 tok/s0.90 s$2.00$8.001.0M–
OpenAI80 tok/s0.78 s$2.00$8.001.0M–

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.500 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0032$0.00282.8 s
Summarize a 30-page report12,000 / 600$0.029$0.0154.6 s
Code edit6,000 / 1,500$0.024$0.01710.2 s
Agentic coding session60,000 / 4,000$0.152$0.08525.8 s
Structured extraction2,000 / 200$0.0056$0.00342.1 s

More from OpenAI

New this month

See also

Questions people ask

What are GPT-4.1's benchmark scores?
As of 25 Oct 2026, GPT-4.1 scores 48.3 ±4.0 on the BenchLeader Index, strongest in human preference (59) and weakest in knowledge (39). That rests on 36 independent benchmark results, and every score on this page links to its publisher.
How does GPT-4.1 rank?
GPT-4.1 is #428 of 785 ranked configurations on 25 Oct 2026. 303 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Opus 5.5 (max effort) at 72.6.
How much does GPT-4.1 cost per 1M tokens?
As of 25 Oct 2026, GPT-4.1 costs $2.00 per 1M input tokens and $8.00 per 1M output tokens, $3.50 blended (three input tokens per output token).
When was GPT-4.1 released?
OpenAI released GPT-4.1 on 14 Apr 2025. BenchLeader has results for it at 2 reasoning-effort settings.

Data as of 25 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “GPT-4.1: benchmarks, pricing, speed and rank”, data as of 25 Oct 2026, https://www.benchleader.com/models/gpt-4-1.