BenchLeader

GPT-5.4 Mini

Reasoning effort

GPT-5.4 Mini is an OpenAI proprietary reasoning model, released 17 Mar 2026. Its best configuration (xhigh reasoning effort) ranks #206 of 785 on the BenchLeader Index at 56.3 ±4.6, in the upper half. The ± is the point: 276 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in instruction following (72) and lowest in agents & tools (50). At $1.69 per million tokens blended it is pricier than most ranked models. Output speed of 241 tokens per second puts it in the fastest quarter, with a first answer in 112.9 s. It has been measured at 6 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 1 Sept 2026.

Blended price
$1.69/M
$0.750 in · $4.50 out
Output speed
241 tok/s
measured by Artificial Analysis
First answer
113 s
first token 1.00 s
Context
400k
Full answer
115 s
median, reasoning included
Cost per run
$0.447
one full Intelligence Index run
Released
17 Mar 2026
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index56
  2. Reasoning53
  3. Coding58
  4. Agents & tools50
  5. Maths51
  6. Knowledge54
  7. Instruction following72
  8. Multimodal56
  9. Long context64
  10. Composite56

Versions

OpenAI has shipped 3 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.

ModelReleasedIndexRank
GPT-5.4 Minixhighthis page17 Mar 202656.3#206
GPT-5 mini7 Aug 202556.5#202
GPT-4.1 minihigh14 Apr 202546.3#492

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning44.0#552176 tok/s0.65 s$0.0017Agents & tools 50 · Coding 42 · Composite 42 · Instruction following 42 · Knowledge 41 · Long context 43 · Maths 35 · Multimodal 43 · Reasoning 44
low––97 tok/s1.00 s$0.0017Maths 39 · Reasoning 31
medium53.6#283213 tok/s3.68 s$0.0017Agents & tools 64 · Composite 52 · Instruction following 64 · Knowledge 52 · Long context 58 · Multimodal 54 · Reasoning 40
high52.2#32597 tok/s1.00 s$0.0017Agents & tools 44 · Coding 52 · Human preference 63 · Knowledge 40 · Maths 62 · Multimodal 58 · Reasoning 51
xhighbest56.3#206241 tok/s113 s$0.0017Agents & tools 50 · Coding 58 · Composite 56 · Instruction following 72 · Knowledge 54 · Long context 64 · Maths 51 · Multimodal 56 · Reasoning 53
not stated––97 tok/s1.00 s$0.0017Coding 38 · Reasoning 36

How its index has moved

8 Sept 2026 to 23 Oct 2026
395061
  • xhigh
  • medium
  • high
  • no reasoning

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoninglowmediumhighxhighnot statedSourceTrend
GPQA Diamond64.1%#184––83.6%#10086.9%#77–Epoch AI Benchmarking Hub
Arena Hard Prompts–––1469#82––Arena (LMArena)
LiveBench 1.0 Reasoningnot in index––––71.3%#63–LiveBench
GPQA Diamond (AA)not in index60.6%#371–82.3%#172–87.5%#97–Artificial Analysis
Humanity's Last Exam (AA)not in index5.9%#413–18.6%#228–28.1%#167–Artificial Analysis
GPQA Diamond (Vals)not in index––––83.1%#57–Vals AI
Kagi LLM Benchmarkeffort not stated–––––37.9%#109Kagi LLM Benchmark
ARC-AGI-1–13.0%#23140.8%#19158.0%#16563.7%#155–ARC Prize
ARC-AGI-2–1.1%#2274.4%#18313.2%#15318.9%#144–ARC Prize
CritPt0.0%#315–2.9%#182–10.0%#121–Artificial Analysis
Chess Puzzlesnot in index2.0%#140––23.0%#8217.0%#102–Epoch AI Benchmarking Hub
Mystery Game Puzzlesnot in index11.0%#1118.0%#1197.0%#123–––Epoch AI Benchmarking Hub
LMCAnot in index––––40.8%#106–Epoch AI Benchmarking Hub
DTBenchnot in index––––80.0%#132–Epoch AI Benchmarking Hub
ForecastBenchnot in indexeffort not stated–––––61.2%#68ForecastBench

Coding

Benchmarkno reasoninghighxhighnot statedSourceTrend
SciCode––52.1%#88–SciCode
WeirdML37.9%#11660.3%#50––WeirdML
FrontierCodeeffort not stated–––27.0%#34Cognition
Arena Coding–1495#88––Arena (LMArena)
Arena WebDev–1397#93––Arena (LMArena)
LiveBench 1.0 Codingnot in index––71.6%#59–LiveBench
SciCode (AA)not in index––52.1%#88–Artificial Analysis
LiveCodeBench––81.5%#59–Vals AI
SWE-bench (Vals)not in index––73.0%#51–Vals AI
Code Migrationnot in index––12.9%#59–Vals AI
ProgramBenchnot in index––0.0%#32–Vals AI
Vibe Code Bench v1.1not in index––48.0%#63–Vals AI
ALE-Benchnot in index–1188.6#44––Epoch AI Benchmarking Hub
Terminal-Bench 4.0 (AA)not in index––2.0%#118–Artificial Analysis
Terminal-Bench 2.1 (AA)not in index––59.2%#101–Artificial Analysis

Agents & tools

Benchmarkno reasoninglowmediumhighxhighSourceTrend
LiveBench Agentic Codingnot in index––––41.7%#59LiveBench
Terminal-Bench Hard18.2%#171–34.1%#89–52.3%#19Artificial Analysis
τ²-Bench Telecom (AA)not in index23.4%#304–36.5%#230–83.3%#110Artificial Analysis
Terminal-Bench 2.1 (Vals)–––54.7%#49–Vals AI
MCP Atlas––––56.7%#30Scale AI SEAL
τ³-Banking (AA)––––25.6%#80Artificial Analysis
ITBench SRE (AA)not in index18.6%#40–––35.2%#27Artificial Analysis
Analyst Agent (AA)not in index––––15.0%#40Artificial Analysis
APEX-Agents (AA)not in index––––28.2%#14Artificial Analysis
Finance Agent v2not in index––––45.4%#54Vals AI
Harvey's Legal Agent Benchmark v1not in index––––0.0%#61Vals AI
Legal Research Benchnot in index––––12.5%#70Vals AI
Tax Agent Benchnot in index––––8.8%#59Vals AI
Terminal-Bench 2.0 (Vals)not in index–––44.9%#24–Vals AI
Terminal-Bench 4.0 (Vals)not in index––––2.5%#46Vals AI
DeepResearch Benchnot in index–36.3%#38–––DeepResearch Bench
AutomationBenchnot in index––––26.2%#124Artificial Analysis
GDP.pdf (AA)not in index––––13.4%#105Artificial Analysis
EnterpriseOps-Gymnot in index––––34.6%#35Artificial Analysis

Maths

Benchmarkno reasoninglowhighxhighSourceTrend
FrontierMath Tiers 1–317.2%#9924.6%#81–51.2%#53Epoch AI Benchmarking Hub
FrontierMath Tier 4–––9.8%#65Epoch AI Benchmarking Hub
OTIS Mock AIME26.7%#212–87.2%#8488.9%#76Epoch AI Benchmarking Hub
ProofBench–––21.0%#49Vals AI
LiveBench Mathematicsnot in index–––78.5%#62LiveBench
AIME (Vals)–––95.6%#8Vals AI
Arena Maths––1439#93–Arena (LMArena)

Knowledge

Benchmarkno reasoningmediumhighxhighSourceTrend
SimpleQA Verified––29.4%#68–Epoch AI Benchmarking Hub
LiveBench 1.0 Data Analysisnot in index–––70.8%#48LiveBench
AA-Omniscience-45.4#353-20.6#245–-18.9#238Artificial Analysis
MMLU-Pro–––84.5%#61Vals AI
CorpFin–––60.9%#62Vals AI
TaxEval–––71.2%#77Vals AI
CaseLaw v2not in index–––51.7%#46Vals AI
Excel Modeling Benchmarknot in index–––45.4%#56Vals AI
AA-Omniscience: accuracynot in index25.6%#22736.5%#149–37.5%#141Artificial Analysis
AA-Omniscience: non-hallucinationnot in index4.4%#53110.2%#417–9.8%#425Artificial Analysis

Instruction following

Benchmarkno reasoningmediumhighxhighSourceTrend
LiveBench Languagenot in index–––71.0%#59LiveBench
LiveBench Instruction Followingnot in index–––59.8%#58LiveBench
IFBench38.8%#27664.8%#105–73.3%#42Artificial Analysis
Arena Instruction Followingnot in index––1434#88–Arena (LMArena)

Human preference

BenchmarkhighSourceTrend
Arena Text1447#83Arena (LMArena)
Arena Creative Writingnot in index1402#105Arena (LMArena)
Arena Multi-turnnot in index1466#71Arena (LMArena)
Arena Longer Queriesnot in index1447#93Arena (LMArena)

Multimodal

Benchmarkno reasoningmediumhighxhighSourceTrend
Arena Vision––1245#68–Arena (LMArena)
MMMU-Pro60.5%#20971.2%#139–73.3%#124Artificial Analysis
MMMU-Pro (Vals)not in index–––79.3%#48Vals AI
MortgageTaxnot in index–––63.5%#50Vals AI
SAGEnot in index–––50.8%#15Vals AI

Long context

Benchmarkno reasoningmediumxhighSourceTrend
AA-LCR37.0%#37067.0%#24377.0%#138Artificial Analysis
MLCRnot in index––20.0%#47Artificial Analysis

Composite

Benchmarkno reasoningmediumxhighnot statedSourceTrend
Epoch Capabilities Indexnot in indexeffort not stated–––148.7#65Epoch AI Benchmarking Hub
LiveBench 1.0not in index––66.4%#63–LiveBench
AA Intelligence Index v4.3.211.1#36119.8#23824.1#180–Artificial Analysis
Vals Multimodal Indexnot in index––54.2%#21–Vals AI

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
OpenAI107 tok/s1.51 s$0.375$2.25400k–
OpenAI97 tok/s0.97 s$0.750$4.50400k–
OpenAI97 tok/s0.88 s$1.50$9.00400k–
Azure53 tok/s1.38 s$0.750$4.50400k–

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.075 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0017$0.00141.9 min
Summarize a 30-page report12,000 / 600$0.012$0.00561.9 min
Code edit6,000 / 1,500$0.011$0.00822.0 min
Agentic coding session60,000 / 4,000$0.063$0.0332.2 min
Structured extraction2,000 / 200$0.0024$0.00141.9 min

More from OpenAI

New this month

See also

Questions people ask

What are GPT-5.4 Mini's benchmark scores?
As of 24 Oct 2026, GPT-5.4 Mini (xhigh effort) scores 56.3 ±4.6 on the BenchLeader Index, strongest in instruction following (72) and weakest in agents & tools (50). That rests on 22 independent benchmark results, and every score on this page links to its publisher.
How does GPT-5.4 Mini rank?
GPT-5.4 Mini (xhigh effort) is #206 of 785 ranked configurations on 24 Oct 2026. 276 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Opus 5.5 (max effort) at 72.6.
How much does GPT-5.4 Mini cost per 1M tokens?
As of 24 Oct 2026, GPT-5.4 Mini costs $0.750 per 1M input tokens and $4.50 per 1M output tokens, $1.69 blended (three input tokens per output token).
When was GPT-5.4 Mini released?
OpenAI released GPT-5.4 Mini on 17 Mar 2026. BenchLeader has results for it at 6 reasoning-effort settings.

Data as of 24 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “GPT-5.4 Mini: benchmarks, pricing, speed and rank”, data as of 24 Oct 2026, https://www.benchleader.com/models/gpt-5-4-mini.