BenchLeader

Agnes 3.0 Flash vs GPT-5.4 Pro

Verdict
  • GPT-5.4 Pro leads on quality: 64.3 vs 62.3.
  • Agnes 3.0 Flash is stronger in agents & tools, composite, long context.
  • GPT-5.4 Pro is stronger in knowledge, reasoning, instruction following, multimodal.
  • Agnes 3.0 Flash is 900× cheaper ($0.075 vs $67.50 per 1M blended).
MetricAgnes 3.0 FlashGPT-5.4 Pro
BenchLeader Index62.364.3
Agents & tools score76.8
Composite score74.0
Knowledge score59.173.6
Long context score67.0
Reasoning score71.175.3
Instruction following score67.3
Multimodal score69.8
Blended price $/M$0.075$67.50
Output speed1 tok/s
Time to first answer5.8 s
Context window1M1.1M
Humanity's Last Exam44.3%
SimpleBench74.1%
Epoch Capabilities Index158.9
AA Intelligence Index35.5
AA-LCR81.0%
AA-Omniscience-10.6
GPQA Diamond (AA)92.4%
Humanity's Last Exam (AA)38.5%
SciCode (AA)51.6%
MultiChallenge69.2%
VISTA53.9%
MultiNRC62.3%
TutorBench56.6%
CritPt15.1%
GDPval (AA)53.7%
τ²-Bench Banking (AA)47.6%
FORTRESS14.8%
MASK91.7%

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

Agnes 3.0 Flash vs GPT-5.4 Pro: questions

Is Agnes 3.0 Flash better than GPT-5.4 Pro?
GPT-5.4 Pro leads on quality: 64.3 vs 62.3. The BenchLeader Index combines every independent quality benchmark; GPT-5.4 Pro is ahead overall as of 2026-09-19, but check the category scores for your use.
Which is cheaper, Agnes 3.0 Flash or GPT-5.4 Pro?
Agnes 3.0 Flash is cheaper: $0.075 against $67.50 per million tokens, blended at three input tokens per output token.
Which has the larger context window?
GPT-5.4 Pro accepts more context: 1.1M against 1M tokens.