BenchLeader

Gemini 3.1 Pro vs GPT-5.6 Sol

Full profiles: Gemini 3.1 Pro (Google) and GPT-5.6 Sol (OpenAI): every benchmark, price and rank.

Updated · Data from 13 sources

As of 25 Oct 2026, GPT-5.6 Sol (max) leads on quality (68.0 vs 60.5 on the BenchLeader Index), but Gemini 3.1 Pro costs 1.8× less, so it is the better buy unless you need the extra quality. GPT-5.6 Sol leads in every category we measure both in.

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingGPT-5.6 Sol66 vs 57 category score; WeirdML 87.0% vs 72.1%High
Agents & tool useGPT-5.6 Sol67 vs 57 category score; τ³-Banking (AA) 44.3% vs 21.4%High
MathsGPT-5.6 Sol71 vs 61 category score; FrontierMath Tiers 1–3 89.1% vs 59.6%High
ReasoningGPT-5.6 Sol72 vs 68 category score; ARC-AGI-2 92.5% vs 77.1%Medium
KnowledgeGPT-5.6 Sol65 vs 64 category score; PRBench Finance 50.5% vs 41.9%Medium
Long documentsGPT-5.6 Sol67 vs 66 category score; AA-LCR 84.0% vs 82.0%Medium
Images and other mediaGPT-5.6 Sol67 vs 65 category score; MMMU-Pro 83.4% vs 82.4%Medium
Following instructionsGPT-5.6 Sol71 vs 68 category score; IFBench 72.7% vs 77.1%Medium
Chat quality (human preference)–Only Gemini 3.1 Pro has an Arena rating (59 category score)Not comparable
Lowest costGemini 3.1 Pro$4.50 vs $8.00 per 1M blended; agentic coding session $0.168 vs $0.320–
Fastest first answerGemini 3.1 Pro21.1 s (Gemini 3.1 Pro) vs 69.5 s (GPT-5.6 Sol (max)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GPT-5.6 Sol (max) leads on quality: 68.0 vs 60.5.
  • Gemini 3.1 Pro is stronger in human preference.
  • GPT-5.6 Sol (max) is stronger in agents & tools, coding, composite, instruction following, knowledge, long context, maths, multimodal, reasoning.
  • Gemini 3.1 Pro is 1.8× cheaper ($4.50 vs $8.00 per 1M blended).
  • Gemini 3.1 Pro streams 1.5× faster (132 vs 89 tokens per second).

At a glance

SpecGemini 3.1 ProGPT-5.6 Sol
DeveloperGoogleOpenAI
Released19 Feb 20269 Jul 2026
Context window (tokens)1,048,5761,050,000
Compared atGemini 3.1 ProGPT-5.6 Sol (max)
Open weightsNoNo
Price in / out / cached input per 1M$2.00 / $12.00 / $0.200$4.00 / $20.00 / $0.400

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGemini 3.1 ProGPT-5.6 Sol (max)Leader
Reasoning68.272.4GPT-5.6 Sol
Coding56.965.9GPT-5.6 Sol
Agents & tools57.166.5GPT-5.6 Sol
Maths60.871.0GPT-5.6 Sol
Knowledge63.965.3GPT-5.6 Sol
Instruction following67.571.1GPT-5.6 Sol
Human preference58.7–not comparable
Multimodal64.866.5GPT-5.6 Sol
Long context66.167.1GPT-5.6 Sol
Composite49.282.0GPT-5.6 Sol

Where sources disagree

Across the 41 benchmarks both have, Gemini 3.1 Pro leads 8, GPT-5.6 Sol leads 32 and 1 is a tie. Independent sources split: Gemini 3.1 Pro leads on Arena Text; GPT-5.6 Sol leads on BenchLeader Index and AA Intelligence Index v4.3.2.

Overall indexGemini 3.1 ProGPT-5.6 Sol (max)Leader
BenchLeader Index60.568.0GPT-5.6 Sol
AA Intelligence Index v4.3.229.747.0GPT-5.6 Sol
Arena Text14871485†Gemini 3.1 Pro

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureGemini 3.1 ProGPT-5.6 Sol (max)
Blended price per 1M tokens$4.50$8.00
Input / output per 1M$2.00 / $12.00$4.00 / $20.00
Cached input per 1M$0.200$0.400
Price per task: chat reply$0.0044$0.0076
Price per task: summarize a 30-page report$0.031$0.060
Price per task: code edit$0.030$0.054
Price per task: agentic coding session$0.168$0.320
Price per task: structured extraction$0.0064$0.012
Cost to run a full benchmark suite$1.30$1.99
Output speed132 tok/s89 tok/s
Time to first answer21.1 s69.5 s
Time to a complete answer24.9 s75.1 s

Per token is not per task: on Artificial Analysis' full suite Gemini 3.1 Pro cost $1.30 and GPT-5.6 Sol (max) $1.99, because Gemini 3.1 Pro used about 1.2× as many tokens for the same work.

Each model is compared at its best-ranked reasoning-effort setting. Gemini 3.1 Pro scores 60.5 and takes 21 s to its first answer token; Gemini 3.1 Pro (high) scores 60.3 in 21 s. GPT-5.6 Sol (max) scores 68.0 and takes 69 s to its first answer token; GPT-5.6 Sol (xhigh) scores 66.6 in 17 s, GPT-5.6 Sol (high) scores 66.3 in 7 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

170 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGemini 3.1 ProGPT-5.6 Sol (max)
BenchLeader IndexBenchLeader60.568.0
Agents & tools scoreBenchLeader57.166.5
Coding scoreBenchLeader56.965.9
Composite scoreBenchLeader49.282.0
Human preference scoreBenchLeader58.7–
Instruction following scoreBenchLeader67.571.1
Knowledge scoreBenchLeader63.965.3
Long context scoreBenchLeader66.167.1
Maths scoreBenchLeader60.871.0
Multimodal scoreBenchLeader64.866.5
Reasoning scoreBenchLeader68.272.4
Blended price $/MBenchLeader$4.50$8.00
Output speedBenchLeader132 tok/s89 tok/s
Time to first answerBenchLeader21.1 s69.5 s
Context windowBenchLeader1,048,576 tokens1,050,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub94.1%93.5%
Humanity's Last ExamScale AI / CAIS46.4%–
SimpleBenchSimpleBench79.6%64.8%†
Arena Hard PromptsArena (LMArena)15081512†
LiveBench 2.0 ReasoningLiveBench84.0%91.7%†
LiveBench 1.0 ReasoningLiveBench84.0%†91.7%
GPQA Diamond (AA)Artificial Analysis94.1%94.1%
Humanity's Last Exam (AA)Artificial Analysis47.0%49.5%
GPQA Diamond (Vals)Vals AI95.5%†95.2%
EnigmaEvalScale AI SEAL36.8%†37.1%†
Kagi LLM BenchmarkKagi LLM Benchmark–67.0%†
ARC-AGI-1ARC Prize98.0%96.5%
ARC-AGI-2ARC Prize77.1%92.5%
ARC-AGI-3ARC Prize0.4%7.8%
CritPtArtificial Analysis17.7%32.3%
MysteryMechanismVals AI20.7%†33.3%
Chess PuzzlesEpoch AI Benchmarking Hub51.0%†59.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub34.0%†58.0%
CL-benchEpoch AI Benchmarking Hub20.8%–
CL-bench LifeEpoch AI Benchmarking Hub16.9%–
LMCAEpoch AI Benchmarking Hub53.8%†58.4%
DTBenchEpoch AI Benchmarking Hub95.5%†95.5%
ForecastBenchForecastBench64.3%65.5%
BTF-3Epoch AI Benchmarking Hub–13.7%
Coding
SciCodeSciCode58.7%57.1%
Show all 170 benchmarks
MetricPublisherGemini 3.1 ProGPT-5.6 Sol (max)
Coding
WeirdMLWeirdML72.1%87.0%
FrontierCodeCognition–47.5%†
GSO-BenchGSO-Bench22.6%76.5%†
Arena CodingArena (LMArena)15221534†
Arena WebDevArena (LMArena)14471615†
LiveBench 2.0 CodingLiveBench66.7%89.7%†
LiveBench 1.0 CodingLiveBench76.5%†83.9%
LiveCodeBenchVals AI88.5%†82.6%
IOIVals AI51.8%†91.2%
SWE-bench (Vals)Vals AI78.8%†96.2%
SWE-Bench ProScale AI SEAL46.1%†–
Code MigrationVals AI17.3%†52.9%
ProgramBenchVals AI0.0%†1.5%
Vibe Code Bench 1-100Vals AI6.7%†20.0%
Vibe Code Bench v1.1Vals AI32.0%†80.5%
SWE-Bench Pro (private)Scale AI SEAL46.1%†–
SWE Atlas: Codebase QnAScale AI SEAL13.5%46.0%†
SWE Atlas: RefactoringScale AI SEAL33.8%–
SWE Atlas: Test WritingScale AI SEAL29.8%45.9%†
MirrorCodeEpoch AI Benchmarking Hub8.9%†20.0%†
Surface Evolver BenchEpoch AI Benchmarking Hub–93.1%†
DeepSWE v1.1Epoch AI Benchmarking Hub11.7%72.7%
CursorBenchCursor–41.7%
ALE-BenchEpoch AI Benchmarking Hub1160.62176.9
AlgoTuneAlgoTune2.0–
FrontierSWEEpoch AI Benchmarking Hub–32.2%
Terminal-Bench 4.0 (AA)Artificial Analysis4.0%39.9%
Terminal-Bench 2.1 (AA)Artificial Analysis73.8%88.0%
Startrise FrontendStartrise–66.2%†
Agents & tools
Terminal-BenchTerminal-Bench80.2%37.3%
OSWorld-Verified 2.0OSWorld–27.3%
APEX-AgentsMercor35.1%–
Arena AgentArena (LMArena)-4.46.1†
LiveBench Long AgenticLiveBench23.9%48.5%†
LiveBench BrowserLiveBench4.0%88.0%†
LiveBench Agentic CodingLiveBench44.1%†56.2%
Terminal-Bench HardArtificial Analysis53.8%65.9%
τ²-Bench Telecom (AA)Artificial Analysis95.6%85.1%
Terminal-Bench 2.1 (Vals)Vals AI70.8%†85.8%
MCP AtlasScale AI SEAL78.2%†–
HiL-BenchScale AI SEAL35.3%32.3%†
τ³-bench Bankingτ²-bench26.0%†46.9%†
GDPval-AA v2.1Artificial Analysis14.6%–
τ³-Banking (AA)Artificial Analysis21.4%44.3%
ITBench SRE (AA)Artificial Analysis30.3%56.2%
Analyst Agent (AA)Artificial Analysis41.3%47.5%
APEX-Agents (AA)Artificial Analysis32.0%–
CUA-benchVals AI–8.3%
CyberBenchVals AI–76.3%
Finance Agent v2Vals AI43.0%†53.8%
Harvey's Legal Agent Benchmark v1Vals AI0.0%†2.5%
Legal Research BenchVals AI20.7%†48.1%
SkillsBenchVals AI–54.1%
SREBenchVals AI0.0%†30.5%
Tax Agent BenchVals AI9.3%†31.1%
Terminal-Bench 2.0 (Vals)Vals AI67.4%†–
Terminal-Bench 4.0 (Vals)Vals AI2.5%†37.9%
Terminal-Bench ScienceVals AI1.4%†20.0%
Time Horizon Index: KSPVals AI–23.8%
Web Search IndexVals AI–43.6%
Arena SearchArena (LMArena)–1258†
BALROGBALROG57.0%60.0%
DeepResearch BenchDeepResearch Bench47.8%†–
PostTrainBenchEpoch AI Benchmarking Hub22.0%36.2%
ExploitBenchEpoch AI Benchmarking Hub26.1%–
METR Time HorizonsMETR77.0%–
GBAEvalEpoch AI Benchmarking Hub0.8%52.6%†
Vending-Bench 2Andon Labs911.29619.4†
AutomationBenchArtificial Analysis35.4%60.1%
GDP.pdf (AA)Artificial Analysis17.8%27.2%
Harvey LAB-AA v1.1Harvey0.0%–
EnterpriseOps-GymArtificial Analysis42.2%42.9%
AA-Briefcase v1.1Artificial Analysis4561479
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–22.4%
BrowseCompOpenAI31.2%–
DeepSearchQAGoogle60.2%–
FACTS SearchGoogle83.7%88.5%†
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub59.6%89.1%
FrontierMath Tier 4Epoch AI Benchmarking Hub26.8%82.9%
OTIS Mock AIMEEpoch AI Benchmarking Hub95.6%100.0%
ProofBenchVals AI26.0%83.0%
LiveBench MathematicsLiveBench91.0%†96.2%
AIME (Vals)Vals AI98.1%†–
AIME 2026MathArena98.3%–
HMMT February 2026MathArena94.7%–
USAMO 2026MathArena74.4%–
MathArena ApexMathArena60.9%–
Arena MathsArena (LMArena)14891496†
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub73.5%†69.7%
LiveBench 2.0 Data AnalysisLiveBench78.5%79.8%†
LiveBench ResearchLiveBench65.7%54.5%†
LiveBench 1.0 Data AnalysisLiveBench78.5%†79.8%
AA-OmniscienceArtificial Analysis31.922.0
MMLU-ProVals AI91.0%†89.1%
LegalBenchVals AI87.4%†87.0%
CorpFinVals AI64.5%†64.4%
TaxEvalVals AI72.9%†74.8%
MedQAVals AI96.4%†–
PRBench FinanceScale AI SEAL41.9%50.5%
PRBench LegalScale AI SEAL44.0%50.5%
MultiNRCScale AI SEAL64.7%–
BioMysteryBenchVals AI60.0%†71.1%
CaseLaw v2Vals AI64.8%†–
Excel Modeling BenchmarkVals AI52.6%†72.3%
MedCodeVals AI59.1%†44.0%
MedScribeVals AI76.1%†85.2%
Public Benefits Bench v1.1Vals AI53.8%†66.5%
DrugDiscoveryBenchScale AI SEAL41.9%†56.5%
EBR-benchEpoch AI Benchmarking Hub14.3%44.8%
GDP.pdfEpoch AI Benchmarking Hub17.0%30.7%
AA-Omniscience: accuracyArtificial Analysis54.9%59.4%
AA-Omniscience: non-hallucinationArtificial Analysis49.1%7.8%
Global-MMLU-Lite (AA)Artificial Analysis93.2%–
Instruction following
LiveBench LanguageLiveBench85.4%†87.7%
LiveBench Instruction FollowingLiveBench79.1%†71.8%
IFBenchArtificial Analysis77.1%72.7%
MultiChallengeScale AI SEAL71.4%–
TutorBenchScale AI SEAL53.0%–
Arena Instruction FollowingArena (LMArena)14801491†
Human preference
Arena TextArena (LMArena)14871485†
EQ-Bench 4EQ-Bench11361240†
Arena Creative WritingArena (LMArena)14811470†
Arena Multi-turnArena (LMArena)14961490†
Arena Longer QueriesArena (LMArena)14991499†
Multimodal
Arena VisionArena (LMArena)12961281†
LiveBench DesignLiveBench61.6%81.6%†
MMMU-ProArtificial Analysis82.4%83.4%
MMMU-Pro (official)MMMU80.5%†–
MMMU-Pro (Vals)Vals AI88.2%†88.8%
MortgageTaxVals AI69.4%†67.3%
SAGEVals AI48.7%†52.6%
VTBScale AI SEAL29.0%–
Blueprint-Bench 2Epoch AI Benchmarking Hub26.5%33.6%†
Long context
AA-LCRArtificial Analysis82.0%84.0%
Arena DocumentArena (LMArena)14591489†
MLCRArtificial Analysis11.1%30.0%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub155.3162.8†
LiveBench 2.0LiveBench54.9%76.3%†
LiveBench 1.0LiveBench77.0%†81.0%
AA Intelligence Index v4.3.2Artificial Analysis29.747.0
Vals RSI IndexVals AI–23.9%
Vals Science IndexVals AI27.4%†41.5%
Vals Multimodal IndexVals AI56.1%†72.6%
Safety & honesty
FORTRESSScale AI SEAL29.8%20.1%†
MASKScale AI SEAL42.4%–

Data as of 2026-10-25. Best configuration of each model; every score links to its source on the model pages.

What changed

  • Gemini 3.1 Pro: 2 score revisions.
  • GPT-5.6 Sol (max): 1 new result (AA-Briefcase v1.1).
  • GPT-5.6 Sol (max): 3 new results (Harvey's Legal Agent Benchmark v1, Vals RSI Index, Vals Science Index).
  • Gemini 3.1 Pro: 2 score revisions.
  • GPT-5.6 Sol (max): 1 score revision.
  • Gemini 3.1 Pro: 1 score revision.
  • GPT-5.6 Sol (max): 1 new result (ForecastBench).
  • Gemini 3.1 Pro: BenchLeader Index 62.4 → 60.7.
  • Gemini 3.1 Pro: 8 new results (LiveBench 2.0, LiveBench Long Agentic, LiveBench 2.0 Reasoning…).
  • Gemini 3.1 Pro: 1 new result (USAMO 2026).

Rankings: Best LLM overall · Best LLM for agents · Best cheap LLMs

Gemini 3.1 Pro vs GPT-5.6 Sol: questions

Is Gemini 3.1 Pro better than GPT-5.6 Sol?
GPT-5.6 Sol (max) leads on quality: 68.0 vs 60.5. The BenchLeader Index combines every independent quality benchmark; GPT-5.6 Sol (max) is ahead overall as of 2026-10-25, but check the category scores for your use.
Which is cheaper, Gemini 3.1 Pro or GPT-5.6 Sol, and will that change?
Gemini 3.1 Pro is cheaper today: $4.50 against $8.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is Gemini 3.1 Pro better than GPT-5.6 Sol for coding?
GPT-5.6 Sol scores higher in coding (66 vs 57 on the category index, where 50 is average). On SciCode, the top shared coding benchmark, it is 58.7% for Gemini 3.1 Pro against 57.1% for GPT-5.6 Sol.
Is Gemini 3.1 Pro better than GPT-5.6 Sol for agents and tool use?
GPT-5.6 Sol scores higher in agentic tasks (67 vs 57 on the category index, where 50 is average). On Terminal-Bench, the top shared agents & tools benchmark, it is 80.2% for Gemini 3.1 Pro against 37.3% for GPT-5.6 Sol.
Which is better for long documents?
GPT-5.6 Sol scores higher on long-context benchmarks (67 vs 66). Both take about 1.1M tokens: Gemini 3.1 Pro 1,048,576, GPT-5.6 Sol 1,050,000.
Which has lower latency?
Gemini 3.1 Pro answers first: 21.1 s against 69.5 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Which is faster, Gemini 3.1 Pro or GPT-5.6 Sol?
Gemini 3.1 Pro streams faster: 132 against 89 output tokens per second.
Do independent benchmarks agree on Gemini 3.1 Pro vs GPT-5.6 Sol?
Across the 41 benchmarks both have, Gemini 3.1 Pro leads 8, GPT-5.6 Sol leads 32 and 1 is a tie. Independent sources split: Gemini 3.1 Pro leads on Arena Text; GPT-5.6 Sol leads on BenchLeader Index and AA Intelligence Index v4.3.2.
When was GPT-5.6 Sol released?
GPT-5.6 Sol was released on 9 Jul 2026.