BenchLeader

GPT-5.4 Nano

Reasoning effort

GPT-5.4 Nano is an OpenAI proprietary reasoning model, released 17 Mar 2026. Its best configuration (xhigh reasoning effort) ranks #259 of 785 on the BenchLeader Index at 54.2 ±6.4, in the upper half. The ± is the point: 352 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in instruction following (74) and lowest in reasoning (45). At $0.463 per million tokens blended it is cheaper than most ranked models. Output speed of 164 tokens per second puts it in the fastest quarter, with a first answer in 45.6 s. It has been measured at 6 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 17 Mar 2026.stale: no new result in six months

Blended price
$0.463/M
$0.200 in · $1.25 out
Output speed
164 tok/s
measured by Artificial Analysis
First answer
46 s
first token 0.95 s
Context
400k
Full answer
49 s
median, reasoning included
Cost per run
$0.183
one full Intelligence Index run
Released
17 Mar 2026
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index54
  2. Reasoning45
  3. Coding50
  4. Agents & tools61
  5. Knowledge48
  6. Instruction following74
  7. Multimodal48
  8. Long context63
  9. Composite53

Versions

OpenAI has shipped 3 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.

ModelReleasedIndexRank
GPT-5.4 Nanoxhighthis page17 Mar 202654.2#259
GPT-5 nano7 Aug 202555.9#220
GPT-4.1 nano14 Apr 202538.0#720

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning42.1#607163 tok/s0.64 s$0.0005Agents & tools 55 · Coding 42 · Composite 43 · Instruction following 36 · Knowledge 45 · Long context 39 · Maths 33 · Multimodal 26 · Reasoning 41
low44.5#53691 tok/s0.95 s$0.0005Maths 42 · Reasoning 40
medium52.4#319161 tok/s3.32 s$0.0005Agents & tools 63 · Composite 52 · Instruction following 64 · Knowledge 53 · Long context 59 · Multimodal 42 · Reasoning 40
high48.4#42791 tok/s0.95 s$0.0005Agents & tools 32 · Coding 58 · Human preference 58 · Knowledge 41 · Maths 51 · Multimodal 51 · Reasoning 46
xhighbest54.2#259164 tok/s46 s$0.0005Agents & tools 61 · Coding 50 · Composite 53 · Instruction following 74 · Knowledge 48 · Long context 63 · Multimodal 48 · Reasoning 45
not stated––91 tok/s0.95 s$0.0005Reasoning 38

How its index has moved

8 Sept 2026 to 23 Oct 2026
385061
  • xhigh
  • medium
  • high
  • low

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoninglowmediumhighxhighnot statedSourceTrend
GPQA Diamond55.6%#20472.2%#162–78.5%#134––Epoch AI Benchmarking Hub
Arena Hard Prompts–––1421#144––Arena (LMArena)
LiveBench 1.0 Reasoningnot in index––––81.1%#51–LiveBench
GPQA Diamond (AA)not in index55.8%#401–76.1%#240–81.7%#178–Artificial Analysis
Humanity's Last Exam (AA)not in index4.1%#544–15.9%#245–28.3%#165–Artificial Analysis
GPQA Diamond (Vals)not in index–––77.5%#73––Vals AI
Kagi LLM Benchmarkeffort not stated–––––39.7%#107Kagi LLM Benchmark
ARC-AGI-1–18.3%#22333.0%#20538.2%#19551.5%#178–ARC Prize
ARC-AGI-2–1.5%#2141.9%#2053.6%#1915.7%#173–ARC Prize
CritPt0.0%#315–5.1%#154–9.3%#127–Artificial Analysis
Chess Puzzlesnot in index2.0%#14020.0%#92–36.0%#4945.0%#29–Epoch AI Benchmarking Hub
Mystery Game Puzzlesnot in index9.0%#1153.0%#1386.0%#1305.0%#132––Epoch AI Benchmarking Hub
LMCAnot in index––––36.9%#122–Epoch AI Benchmarking Hub
DTBenchnot in index––––80.3%#130–Epoch AI Benchmarking Hub
ForecastBenchnot in indexeffort not stated–––––58.6%#79ForecastBench

Coding

Benchmarkno reasoninghighxhighSourceTrend
SciCode––47.2%#126SciCode
WeirdML38.0%#11549.2%#72–WeirdML
Arena Coding–1460#129–Arena (LMArena)
LiveBench 1.0 Codingnot in index––70.8%#60LiveBench
SciCode (AA)not in index––47.2%#134Artificial Analysis
LiveCodeBench–84.0%#40–Vals AI
SWE-bench (Vals)not in index–69.8%#61–Vals AI
Code Migrationnot in index–14.5%#55–Vals AI
Vibe Code Bench v1.1not in index–26.1%#75–Vals AI
ALE-Benchnot in index–1004.5#58–Epoch AI Benchmarking Hub
Terminal-Bench 4.0 (AA)not in index––0.5%#139Artificial Analysis
Terminal-Bench 2.1 (AA)not in index––60.7%#98Artificial Analysis

Agents & tools

Benchmarkno reasoningmediumhighxhighSourceTrend
LiveBench Agentic Codingnot in index–––46.8%#50LiveBench
Terminal-Bench Hard24.2%#14433.3%#92–42.4%#46Artificial Analysis
τ²-Bench Telecom (AA)not in index34.8%#23752.6%#193–76.0%#134Artificial Analysis
Terminal-Bench 2.1 (Vals)––41.6%#66–Vals AI
τ³-Banking (AA)–––27.4%#76Artificial Analysis
ITBench SRE (AA)not in index12.9%#42––24.4%#37Artificial Analysis
APEX-Agents (AA)not in index–––24.9%#18Artificial Analysis
Finance Agent v2not in index––38.2%#62–Vals AI
Harvey's Legal Agent Benchmark v1not in index––0.0%#61–Vals AI
Legal Research Benchnot in index––6.3%#74–Vals AI
Tax Agent Benchnot in index––5.0%#67–Vals AI
Terminal-Bench 2.0 (Vals)not in index––39.9%#34–Vals AI
AutomationBenchnot in index–––6.0%#162Artificial Analysis
GDP.pdf (AA)not in index–––7.8%#146Artificial Analysis
EnterpriseOps-Gymnot in index–––31.5%#39Artificial Analysis

Maths

Benchmarkno reasoninglowhighxhighSourceTrend
FrontierMath Tiers 1–34.6%#11220.4%#8744.9%#57–Epoch AI Benchmarking Hub
FrontierMath Tier 4––12.2%#62–Epoch AI Benchmarking Hub
OTIS Mock AIME46.7%#18768.9%#14187.8%#83–Epoch AI Benchmarking Hub
ProofBench––5.0%#71–Vals AI
LiveBench Mathematicsnot in index–––91.0%#33LiveBench
AIME (Vals)––88.8%#28–Vals AI
Arena Maths––1424#113–Arena (LMArena)

Knowledge

Benchmarkno reasoningmediumhighxhighSourceTrend
SimpleQA Verified––11.7%#83–Epoch AI Benchmarking Hub
LiveBench 1.0 Data Analysisnot in index–––67.6%#55LiveBench
AA-Omniscience-37.5#312-18.0#237–-29.5#277Artificial Analysis
MMLU-Pro––77.2%#101–Vals AI
LegalBench––77.9%#101–Vals AI
CorpFin––61.2%#56–Vals AI
TaxEval––67.4%#103–Vals AI
CaseLaw v2not in index––51.9%#45–Vals AI
Excel Modeling Benchmarknot in index––44.8%#57–Vals AI
MedCodenot in index––41.0%#57–Vals AI
MedScribenot in index––77.1%#70–Vals AI
AA-Omniscience: accuracynot in index14.9%#42621.9%#280–25.7%#226Artificial Analysis
AA-Omniscience: non-hallucinationnot in index38.5%#16948.9%#122–25.8%#236Artificial Analysis

Instruction following

Benchmarkno reasoningmediumhighxhighSourceTrend
LiveBench Languagenot in index–––62.5%#65LiveBench
LiveBench Instruction Followingnot in index–––67.2%#37LiveBench
IFBench32.7%#33864.4%#108–75.9%#24Artificial Analysis
Arena Instruction Followingnot in index––1387#151–Arena (LMArena)

Human preference

BenchmarkhighSourceTrend
Arena Text1401#149Arena (LMArena)
Arena Creative Writingnot in index1337#180Arena (LMArena)
Arena Multi-turnnot in index1413#138Arena (LMArena)
Arena Longer Queriesnot in index1403#157Arena (LMArena)

Multimodal

Benchmarkno reasoningmediumhighxhighSourceTrend
Arena Vision––1196#93–Arena (LMArena)
MMMU-Pro43.8%#25859.5%#215–65.4%#175Artificial Analysis
MMMU-Pro (Vals)not in index––73.6%#57–Vals AI
MortgageTaxnot in index––59.1%#65–Vals AI
SAGEnot in index––38.1%#63–Vals AI

Long context

Benchmarkno reasoningmediumxhighSourceTrend
AA-LCR29.7%#39667.3%#24076.7%#140Artificial Analysis
MLCRnot in index––16.1%#69Artificial Analysis

Composite

Benchmarkno reasoningmediumhighxhighnot statedSourceTrend
Epoch Capabilities Indexnot in indexeffort not stated––––146.0#78Epoch AI Benchmarking Hub
LiveBench 1.0not in index–––69.6%#55–LiveBench
AA Intelligence Index v4.3.211.7#34720.0#236–20.7#224–Artificial Analysis
Vals Multimodal Indexnot in index––47.6%#26––Vals AI

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
OpenAI91 tok/s0.87 s$0.200$1.25400k–
Azure65 tok/s1.75 s$0.200$1.25400k–

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.020 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0005$0.000447.4 s
Summarize a 30-page report12,000 / 600$0.0032$0.001549.2 s
Code edit6,000 / 1,500$0.0031$0.002354.7 s
Agentic coding session60,000 / 4,000$0.017$0.00891.2 min
Structured extraction2,000 / 200$0.0007$0.000446.8 s

More from OpenAI

New this month

See also

Questions people ask

What are GPT-5.4 Nano's benchmark scores?
As of 24 Oct 2026, GPT-5.4 Nano (xhigh effort) scores 54.2 ±6.4 on the BenchLeader Index, strongest in instruction following (74) and weakest in reasoning (45). That rests on 11 independent benchmark results, and every score on this page links to its publisher.
How does GPT-5.4 Nano rank?
GPT-5.4 Nano (xhigh effort) is #259 of 785 ranked configurations on 24 Oct 2026. 352 other configurations score within its margin, so the exact position matters less than the band. The leader is Claude Opus 5.5 (max effort) at 72.6.
How much does GPT-5.4 Nano cost per 1M tokens?
As of 24 Oct 2026, GPT-5.4 Nano costs $0.200 per 1M input tokens and $1.25 per 1M output tokens, $0.463 blended (three input tokens per output token).
When was GPT-5.4 Nano released?
OpenAI released GPT-5.4 Nano on 17 Mar 2026. BenchLeader has results for it at 6 reasoning-effort settings.

Data as of 24 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “GPT-5.4 Nano: benchmarks, pricing, speed and rank”, data as of 24 Oct 2026, https://www.benchleader.com/models/gpt-5-4-nano.