BenchLeader

Gemini 2.5 Pro Preview 0325 vs GPT-5.6 Sol

Full profiles: Gemini 2.5 Pro Preview 0325 (Google) and GPT-5.6 Sol (OpenAI): every benchmark, price and rank.

Updated · Data from 13 sources

As of 22 Nov 2026, GPT-5.6 Sol is ahead of Gemini 2.5 Pro Preview 0325 on quality (65.1 vs 59.7 on the BenchLeader Index). Choose Gemini 2.5 Pro Preview 0325 for long context (73 vs 67) and multimodal (71 vs 66); choose GPT-5.6 Sol for instruction following (71 vs 58), reasoning (64 vs 52), and maths (69 vs 59).

Key facts (as of 22 Nov 2026)

  • Gemini 2.5 Pro Preview 0325 scores 59.7 on the BenchLeader Index and GPT-5.6 Sol scores 65.1 (BenchLeader, 22 Nov 2026).
  • GPT-5.6 Sol costs $8.00 per 1M tokens blended (list price, 22 Nov 2026).
  • Of the 14 benchmarks both models have, GPT-5.6 Sol leads 14 (BenchLeader, 22 Nov 2026).

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingGPT-5.6 Sol66 vs 61 category score; LiveCodeBench 82.6% vs 79.2%Medium
MathsGPT-5.6 Sol69 vs 59 category scoreHigh
ReasoningGPT-5.6 Sol64 vs 52 category score; GPQA Diamond 93.5% vs 83.8%High
KnowledgeGPT-5.6 Sol63 vs 56 category score; MMLU-Pro 89.1% vs 84.1%Medium
Long documentsGemini 2.5 Pro Preview 032573 vs 67 category scoreMedium
Images and other mediaGemini 2.5 Pro Preview 032571 vs 66 category score; MMMU-Pro (Vals) 81.3% vs 88.8%Medium
Following instructionsGPT-5.6 Sol71 vs 58 category scoreHigh
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GPT-5.6 Sol (max) leads on quality: 65.1 vs 59.7.
  • Gemini 2.5 Pro Preview 0325 is stronger in long context, multimodal.
  • GPT-5.6 Sol (max) is stronger in coding, instruction following, knowledge, maths, reasoning.

At a glance

SpecGemini 2.5 Pro Preview 0325GPT-5.6 Sol
DeveloperGoogleOpenAI
Released25 Mar 20259 Jul 2026
Context window (tokens)1,000,0001,050,000
Compared atGemini 2.5 Pro Preview 0325GPT-5.6 Sol (max)
Open weightsNoNo
Price in / out / cached input per 1M–$4.00 / $20.00 / $0.400

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGemini 2.5 Pro Preview 0325GPT-5.6 Sol (max)Leader
Reasoning52.163.8GPT-5.6 Sol
Coding61.165.9GPT-5.6 Sol
Agents & tools–67.4not comparable
Maths58.969.4GPT-5.6 Sol
Knowledge56.263.4GPT-5.6 Sol
Instruction following57.971.3GPT-5.6 Sol
Multimodal70.865.5Gemini 2.5 Pro Preview 0325
Long context72.866.8Gemini 2.5 Pro Preview 0325

On one chart

Each domain on the index's own scale, where 50 is an average model. Click a domain to see the benchmarks behind it. Pick up to 5 models from the list.

2550 avg75ReasoningCodingMathsKnowledgeInstructionfollowingLong contextMultimodalGemini 2.5 Pro Preview 0325, Reasoning: 52.1Gemini 2.5 Pro Preview 0325, Coding: 61.1Gemini 2.5 Pro Preview 0325, Maths: 58.9Gemini 2.5 Pro Preview 0325, Knowledge: 56.2Gemini 2.5 Pro Preview 0325, Instruction following: 57.9Gemini 2.5 Pro Preview 0325, Long context: 72.8Gemini 2.5 Pro Preview 0325, Multimodal: 70.8GPT-5.6 Sol, Reasoning: 63.8GPT-5.6 Sol, Coding: 65.9GPT-5.6 Sol, Maths: 69.4GPT-5.6 Sol, Knowledge: 63.4GPT-5.6 Sol, Instruction following: 71.3GPT-5.6 Sol, Long context: 66.8GPT-5.6 Sol, Multimodal: 65.5

Not drawn, measured for fewer than two of these models: Agents & tools, Human preference.

Model, click to add or removeIndex

Where sources disagree

Across the 14 benchmarks both have, Gemini 2.5 Pro Preview 0325 leads 0, GPT-5.6 Sol leads 14. Every overall index that rates both puts GPT-5.6 Sol ahead.

Overall indexGemini 2.5 Pro Preview 0325GPT-5.6 Sol (max)Leader
BenchLeader Index59.765.1GPT-5.6 Sol

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page. Cost, tokens and time per benchmark task are measured: Artificial Analysis’ averages over its whole Intelligence Index run.

MeasureGemini 2.5 Pro Preview 0325GPT-5.6 Sol (max)
Blended price per 1M tokens–$8.00
Input / output per 1M– / –$4.00 / $20.00
Cached input per 1M–$0.400
Price per task: chat reply–$0.0076
Price per task: summarize a 30-page report–$0.060
Price per task: code edit–$0.054
Price per task: agentic coding session–$0.320
Price per task: structured extraction–$0.012
Agentic coding session, input mostly cached–$0.158
Output speed–108 tok/s
Time to first answer–33.8 s
Time to a complete answer, last measured 13 Nov 2026–157.3 s

Each model is compared at its best-ranked reasoning-effort setting. Gemini 2.5 Pro Preview 0325 scores 59.7. GPT-5.6 Sol (max) scores 65.1 and takes 34 s to its first answer token; GPT-5.6 Sol (xhigh) scores 63.7 in 15 s, GPT-5.6 Sol (high) scores 63.3 in 7 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

173 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGemini 2.5 Pro Preview 0325GPT-5.6 Sol (max)
BenchLeader IndexBenchLeader59.765.1
Coding scoreBenchLeader61.165.9
Instruction following scoreBenchLeader57.971.3
Knowledge scoreBenchLeader56.263.4
Long context scoreBenchLeader72.866.8
Maths scoreBenchLeader58.969.4
Multimodal scoreBenchLeader70.865.5
Reasoning scoreBenchLeader52.163.8
Agents & tools scoreBenchLeader–67.4
Blended price $/MBenchLeader–$8.00
Output speedBenchLeader–108 tok/s
Time to first answerBenchLeader–33.8 s
Context windowBenchLeader1,000,000 tokens1,050,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub83.8%93.5%
Humanity's Last ExamScale AI / CAIS18.2%–
SimpleBenchSimpleBench51.6%64.8%†
Arena Hard PromptsArena (LMArena)–1511†
LiveBench 1.0 ReasoningLiveBench–91.7%
GPQA Diamond (AA)Artificial Analysis83.6%94.1%
Humanity's Last Exam (AA)Artificial Analysis18.0%49.5%
GPQA Diamond (Vals)Vals AI80.8%95.2%
EnigmaEvalScale AI SEAL–37.1%†
GPQA Diamond (HELM)HELM Capabilities74.9%–
ARC-AGI-1ARC Prize–96.5%
ARC-AGI-2ARC Prize–92.5%
ARC-AGI-3ARC Prize–7.8%
CritPtArtificial Analysis–32.3%
CritPt v2 hard subset (AA)Artificial Analysis–60.0%
MysteryMechanismVals AI–33.3%
HLE-Diamond (Scale)Scale AI SEAL–31.2%†
HLE Text-Only (Scale)Scale AI SEAL18.4%–
Arena ExpertArena (LMArena)–1532†
Chess PuzzlesEpoch AI Benchmarking Hub–59.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub–58.0%
LMCAEpoch AI Benchmarking Hub–58.4%
DTBenchEpoch AI Benchmarking Hub–95.5%
ForecastBenchForecastBench64.0%65.7%
BTF-3Epoch AI Benchmarking Hub–13.7%
Show all 173 benchmarks
MetricPublisherGemini 2.5 Pro Preview 0325GPT-5.6 Sol (max)
Coding
SciCodeSciCode–57.1%
WeirdMLWeirdML–87.0%
FrontierCodeCognition–47.5%†
GSO-BenchGSO-Bench–76.5%†
Arena CodingArena (LMArena)–1533†
Arena WebDevArena (LMArena)–1615†
LiveBench 1.0 CodingLiveBench–83.9%
LiveCodeBenchVals AI79.2%82.6%
IOIVals AI–91.2%
SWE-bench (Vals)Vals AI–96.2%
Aider PolyglotAider polyglot leaderboard72.9%–
Code MigrationVals AI–52.9%
ProgramBenchVals AI–1.5%
Vibe Code Bench 1-100Vals AI–20.0%
Vibe Code Bench v1.1Vals AI–80.5%
SWE Atlas v1.0: Codebase QnAScale AI SEAL–46.0%†
SWE Atlas v1.0: Test WritingScale AI SEAL–45.9%†
SWE-Bench Pro V2Scale AI SEAL–95.5%†
SWE-Bench Pro V2 HARDScale AI SEAL–82.4%†
MirrorCodeEpoch AI Benchmarking Hub–20.0%†
CadEvalEpoch AI Benchmarking Hub64.0%–
Surface Evolver BenchEpoch AI Benchmarking Hub–93.1%†
DeepSWE v1.1Epoch AI Benchmarking Hub–72.7%
CursorBenchCursor–40.9%
ALE-BenchEpoch AI Benchmarking Hub–2176.9
FrontierSWEEpoch AI Benchmarking Hub–32.2%
WeirdML v3WeirdML–15.0%†
Terminal-Bench 4.0 (AA)Artificial Analysis–39.9%
Terminal-Bench 2.1 (AA)Artificial Analysis–88.0%
Startrise FrontendStartrise–66.2%†
GameBench 2 OverallDuelLab GameBench 2–66.8†
GameBench 2 by reasoning settingDuelLab GameBench 2–80.1†
Design Arena WebsiteDesign Arena–1310†
Design Arena CodeDesign Arena–1331†
LiveCodeBench (AA)Artificial Analysis77.8%–
Agents & tools
Terminal-BenchTerminal-Bench–38.5%
OSWorld-Verified 2.0OSWorld–27.3%
APEX-AgentsMercor–51.4%†
Arena AgentArena (LMArena)–3.7†
LiveBench Agentic CodingLiveBench–56.2%
Terminal-Bench HardArtificial Analysis–65.9%
τ²-Bench Telecom (AA)Artificial Analysis–85.1%
Terminal-Bench 2.1 (Vals)Vals AI–85.8%
MCP AtlasScale AI SEAL–81.8%†
HiL-BenchScale AI SEAL–32.3%†
τ³-bench Bankingτ²-bench–46.9%†
GDPval-AA v2.1Artificial Analysis–1619
τ³-Banking (AA)Artificial Analysis–44.3%
ITBench SRE (AA)Artificial Analysis–56.2%
Analyst Agent (AA)Artificial Analysis–47.5%
CUA-benchVals AI–8.3%
CyberBenchVals AI–76.3%
Finance Agent v2Vals AI–53.8%
Harvey's Legal Agent Benchmark v1Vals AI–2.5%
Legal Research BenchVals AI–48.1%
SkillsBenchVals AI–54.1%
SREBenchVals AI–30.5%
Tax Agent BenchVals AI–31.1%
Terminal-Bench 4.0 (Vals)Vals AI–37.9%
Terminal-Bench ScienceVals AI–20.0%
Time Horizon Index: KSPVals AI–23.8%
Web Search IndexVals AI–43.6%
Arena SearchArena (LMArena)–1254†
Arena Agent Task CompletionArena (LMArena)–2.5†
Arena Search FactualityArena (LMArena)–1248†
BALROGBALROG43.3%60.0%
PostTrainBenchEpoch AI Benchmarking Hub–31.0%
GBAEvalEpoch AI Benchmarking Hub–52.6%†
Vending-Bench 2Andon Labs–9619.4†
AutomationBenchArtificial Analysis–60.1%
GDP.pdf (AA)Artificial Analysis–27.2%
EnterpriseOps-GymArtificial Analysis–42.9%
AA-Briefcase v1.1Artificial Analysis–1478
Design Arena AgenticDesign Arena–1226†
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–22.4%
FACTS SearchGoogle–92.9%†
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub–89.1%
FrontierMath Tier 4Epoch AI Benchmarking Hub–82.9%
OTIS Mock AIMEEpoch AI Benchmarking Hub–100.0%
MATH Level 5Epoch AI Benchmarking Hub95.6%–
ProofBenchVals AI–83.0%
LiveBench MathematicsLiveBench–96.2%
AIME (Vals)Vals AI85.8%–
Omni-MATH (HELM)HELM Capabilities41.6%–
MATH 500Vals AI95.2%–
Arena MathsArena (LMArena)–1494†
FrontierMath ErdősEpoch AI Benchmarking Hub–0.0%
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub–69.7%
LiveBench 1.0 Data AnalysisLiveBench–79.8%
MMLU-ProVals AI84.1%89.1%
LegalBenchVals AI84.3%87.0%
CorpFinVals AI59.8%64.4%
TaxEvalVals AI72.9%74.8%
MedQAVals AI93.1%–
PRBench FinanceScale AI SEAL–50.5%
PRBench LegalScale AI SEAL–50.5%
MMLU-Pro (HELM)HELM Capabilities86.3%–
BioMysteryBenchVals AI–71.1%
Excel Modeling BenchmarkVals AI–72.3%
MedCodeVals AI–44.0%
MedScribeVals AI–85.2%
Public Benefits Bench v1.1Vals AI–66.5%
Financial Coaching BenchVals AI–74.9%
DrugDiscoveryBenchScale AI SEAL–56.5%
Arena Text FactualityArena (LMArena)–1476†
EBR-benchEpoch AI Benchmarking Hub–44.8%
FACTS ParametricGoogle–81.1%†
Instruction following
LiveBench LanguageLiveBench–87.7%
LiveBench Instruction FollowingLiveBench–71.8%
IFBenchArtificial Analysis–72.7%
IFEval (HELM)HELM Capabilities84.0%–
WildBench (HELM)HELM Capabilities85.7%–
Arena Instruction FollowingArena (LMArena)–1490†
Human preference
Arena TextArena (LMArena)–1485†
EQ-Bench 4EQ-Bench–1236†
EQ-Bench Creative Writing v3EQ-Bench13961974†
EQ-Bench Longform WritingEQ-Bench58.881.7†
Arena Creative WritingArena (LMArena)–1471†
Arena Multi-turnArena (LMArena)–1491†
Arena Longer QueriesArena (LMArena)–1498†
Lech Mazur Creative WritingLech Mazur80.5%–
Multimodal
Arena VisionArena (LMArena)–1282†
MMMU-ProArtificial Analysis–83.4%
VISTAScale AI SEAL54.6%–
MMMU-Pro (Vals)Vals AI81.3%88.8%
MortgageTaxVals AI67.2%67.3%
Humanity's Sixth SenseScale AI SEAL–30.0%
GeoBenchGeoBench84.0%73.0%†
VPCTEpoch AI Benchmarking Hub48.0%–
Blueprint-Bench 2Epoch AI Benchmarking Hub–33.6%†
Furniture AssemblyEpoch AI Benchmarking Hub–56.7%
FACTS MultimodalGoogle–46.4%†
Long context
Fiction.LiveBench 120kFiction.live90.6%–
AA-LCR v1.1Artificial Analysis–84.0%
Arena DocumentArena (LMArena)–1487†
MLCRArtificial Analysis–30.0%
FACTS GroundingGoogle–61.9%†
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub144.0163.0†
LiveBench 1.0LiveBench–81.0%
AA Intelligence Index v4.3.2Artificial Analysis15.047.0
AA Progress Index v1Artificial Analysis245.9331.5
HELM Capabilities meanHELM Capabilities74.5%–
Vals RSI IndexVals AI–23.9%
Vals Science IndexVals AI–41.5%
Vals Multimodal IndexVals AI–72.6%
Safety & honesty
FORTRESSScale AI SEAL54.9%20.1%†
MASKScale AI SEAL55.9%–
DistressBenchScale AI SEAL–73.6%†

Data as of 2026-11-22. Best configuration of each model; every score links to its source on the model pages.

DuelLab GameBench 2, release gb2-20261119-1d7fd529faf6 (https://benchmarks.duellab.org/releases/gb2-20261119-1d7fd529faf6/), CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Scores mapped to BenchLeader model names; not endorsed by DuelLab.

What changed

  • GPT-5.6 Sol (max): 1 score revision.
  • GPT-5.6 Sol (max): 1 new result (GDPval-AA v2.1).
  • GPT-5.6 Sol (max): 1 score revision.
  • GPT-5.6 Sol (max): BenchLeader Index 65.8 → 65.3.
  • GPT-5.6 Sol (max): 1 score revision.
  • GPT-5.6 Sol (max): 1 score revision.
  • GPT-5.6 Sol (max): 2 new results (AA Progress Index v1, CritPt v2 hard subset (AA)).
  • GPT-5.6 Sol (max): 1 new result (AA-Briefcase v1.1).
  • GPT-5.6 Sol (max): 3 new results (Harvey's Legal Agent Benchmark v1, Vals RSI Index, Vals Science Index).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Gemini 2.5 Pro Preview 0325 vs GPT-5.6 Sol: questions

Is GPT-5.6 Sol better than Gemini 2.5 Pro Preview 0325?
GPT-5.6 Sol (max) leads on quality: 65.1 vs 59.7. The BenchLeader Index combines every independent quality benchmark; GPT-5.6 Sol (max) is ahead overall as of 22 Nov 2026, but check the category scores for your use.
Is Gemini 2.5 Pro Preview 0325 or GPT-5.6 Sol better for coding?
GPT-5.6 Sol scores higher in coding (66 vs 61 on the category index, where 50 is average). On LiveCodeBench, the top shared coding benchmark, it is 79.2% for Gemini 2.5 Pro Preview 0325 against 82.6% for GPT-5.6 Sol.
Which is better for long documents?
Gemini 2.5 Pro Preview 0325 scores higher on long-context benchmarks (73 vs 67). Both take about 1.1M tokens: Gemini 2.5 Pro Preview 0325 1,000,000, GPT-5.6 Sol 1,050,000.
Do independent benchmarks agree on Gemini 2.5 Pro Preview 0325 vs GPT-5.6 Sol?
Across the 14 benchmarks both have, Gemini 2.5 Pro Preview 0325 leads 0, GPT-5.6 Sol leads 14. Every overall index that rates both puts GPT-5.6 Sol ahead.
When was GPT-5.6 Sol released?
GPT-5.6 Sol was released on 9 Jul 2026.