BenchLeader

GPT-5 Pro vs GPT-6.1 Sol

Verdict
  • GPT-6.1 Sol (max) leads on quality: 69.3 vs 60.2.
  • GPT-5 Pro is stronger in multimodal.
  • GPT-6.1 Sol (max) is stronger in knowledge, reasoning, agents & tools, coding, composite, human preference, long context, maths.
  • GPT-6.1 Sol (max) is 10× cheaper ($4.00 vs $41.25 per 1M blended).
MetricGPT-5 ProGPT-6.1 Sol (max)
BenchLeader Index60.269.3
Knowledge score67.078.8
Multimodal score67.466.2
Reasoning score56.376.4
Agents & tools score–63.9
Coding score–72.4
Composite score–79.0
Human preference score–68.1
Long context score–66.8
Maths score–72.5
Blended price $/M$41.25$4.00
Output speed–56 tok/s
Time to first answer–326.9 s
Context window400k1.1M
GPQA Diamond–95.4%
FrontierMath Tiers 1–3–93.7%
FrontierMath Tier 4–100.0%
OTIS Mock AIME–100.0%
SimpleQA Verified–73.9%
Humanity's Last Exam31.6%–
Terminal-Bench–58.2%
SimpleBench61.6%–
SciCode–54.2%
APEX-Agents–60.0%
Epoch Capabilities Index150.3–
LMArena Text–1484
LMArena Hard Prompts–1507
LMArena Coding–1545
LMArena WebDev–1755
LMArena Vision–1288
LMArena Agent–11.7
LiveBench–81.6%
LiveBench Reasoning–92.6%
LiveBench Coding–80.4%
LiveBench Agentic Coding–54.5%
LiveBench Mathematics–96.8%
LiveBench Data Analysis–82.7%
LiveBench Language–90.1%
LiveBench Instruction Following–74.2%
AA Intelligence Index v4.3.2–51.8
AA-LCR–83.0%
MMMU-Pro–86.0%
AA-Omniscience–41.5
Humanity's Last Exam (AA)–52.9%
SciCode (AA)–54.2%
IOI–96.9%
Vals Index–61.1
PRBench Finance51.1%–
PRBench Legal49.9%–
VISTA52.4%–
MultiNRC65.2%–
Kagi LLM Benchmark76.8%–
ARC-AGI-170.2%96.5%
ARC-AGI-218.3%94.2%
ARC-AGI-3–96.2%
CritPt–31.7%
GDPval-AA v2.1–53.8%
Analyst Agent (AA)–50.0%
BioMysteryBench–79.6%
Code Migration–65.1%
CyberBench–39.3%
Excel Modeling Benchmark–70.8%
Finance Agent v2–52.0%
Harvey's Legal Agent Benchmark–5.4%
Legal Research Bench–38.5%
MedCode–48.8%
MedScribe–86.5%
MysteryMechanism–46.4%
Public Benefits Bench–59.3%
SAGE–46.5%
SREBench–50.8%
Tax Agent Bench–62.3%
Terminal-Bench 4.0 (Vals)–55.0%
Vibe Code Bench v1.1–88.9%
FORTRESS15.2%–
MASK86.0%–
LMArena Maths–1488
LMArena Creative Writing–1462
LMArena Instruction Following–1488
LMArena Multi-turn–1487
LMArena Longer Queries–1496
Chess Puzzles–61.0%
EBR-bench–54.3%
Mystery Game Puzzles–80.0%
Terminal-Bench 4.0 (AA)–56.1%
AutomationBench–64.9%
GDP.pdf–31.0%
MLCR–33.9%
Harvey LAB–6.9%
AA-Omniscience: accuracy–62.1%
AA-Omniscience: non-hallucination–45.7%
AA-Briefcase v1.1–1557
DeepSearchQA65.2%–

Data as of 2026-10-11. Best configuration of each model; every score links to its source on the model pages.

GPT-5 Pro vs GPT-6.1 Sol: questions

Is GPT-5 Pro better than GPT-6.1 Sol?
GPT-6.1 Sol (max) leads on quality: 69.3 vs 60.2. The BenchLeader Index combines every independent quality benchmark; GPT-6.1 Sol (max) is ahead overall as of 2026-10-11, but check the category scores for your use.
Which is cheaper, GPT-5 Pro or GPT-6.1 Sol?
GPT-6.1 Sol is cheaper: $4.00 against $41.25 per million tokens, blended at three input tokens per output token.
Which has the larger context window?
GPT-6.1 Sol accepts more context: 1.1M against 400k tokens.