BenchLeader

Gemini 3.1 Pro vs GPT-6 Astra

Full profiles: Gemini 3.1 Pro (Google) and GPT-6 Astra (OpenAI): every benchmark, price and rank.

Updated · Data from 13 sources

As of 24 Oct 2026, GPT-6 Astra (max) leads on quality (70.4 vs 60.6 on the BenchLeader Index), but Gemini 3.1 Pro costs 4.4× less, so it is the better buy unless you need the extra quality. GPT-6 Astra leads in every category we measure both in.

Which to pick for…

The pick's numbers come first. Category scores on the BenchLeader scale (50 is the average model, 15 points one standard deviation). High confidence means a lead of half a standard deviation or more; under one point is called either.

Use casePickWhyConfidence
CodingGPT-6 Astra74 vs 57 category score; Arena WebDev 1775 vs 1447High
Agents & tool useGPT-6 Astra64 vs 57 category score; τ³-Banking (AA) 41.4% vs 21.4%Medium
MathsGPT-6 Astra72 vs 61 category score; FrontierMath Tiers 1–3 93.7% vs 59.6%High
ReasoningGPT-6 Astra76 vs 68 category score; GPQA Diamond 95.8% vs 94.1%High
KnowledgeGPT-6 Astra80 vs 64 category score; AA-Omniscience 43.4 vs 31.9High
Long documentsEither66 vs 65 category score; AA-LCR 82.0% vs 80.7%Either
Images and other mediaGPT-6 Astra66 vs 65 category score; MMMU-Pro 86.9% vs 82.4%Medium
Chat quality (human preference)GPT-6 Astra67 vs 59 on Arena votesHigh
Lowest costGemini 3.1 Pro$4.50 vs $20.00 per 1M blended; agentic coding session $0.168 vs $0.800–
Fastest first answerGemini 3.1 Pro21.1 s (Gemini 3.1 Pro) vs 247.0 s (GPT-6 Astra (max)) to the first answer token–
High volume on a budgetNeither flagshipA smaller model is usually the better fit: Cheapest good LLMs, Fastest LLMs–

Key differences

  • GPT-6 Astra (max) leads on quality: 70.4 vs 60.6.
  • Gemini 3.1 Pro is stronger in instruction following, long context.
  • GPT-6 Astra (max) is stronger in agents & tools, coding, composite, human preference, knowledge, maths, multimodal, reasoning.
  • Gemini 3.1 Pro is 4.4× cheaper ($4.50 vs $20.00 per 1M blended).
  • Gemini 3.1 Pro streams 2.3× faster (132 vs 58 tokens per second).

At a glance

SpecGemini 3.1 ProGPT-6 Astra
DeveloperGoogleOpenAI
Released19 Feb 20262 Sept 2026
Context window (tokens)1,048,5761,050,000
Compared atGemini 3.1 ProGPT-6 Astra (max)
Open weightsNoNo
Price in / out / cached input per 1M$2.00 / $12.00 / $0.200$10.00 / $50.00 / $1.00

Category by category

Category scores on the BenchLeader scale: 50 is the average evaluated model, 15 points is one standard deviation. A gap under one point is called level.

CategoryGemini 3.1 ProGPT-6 Astra (max)Leader
Reasoning68.276.2GPT-6 Astra
Coding57.074.0GPT-6 Astra
Agents & tools57.164.2GPT-6 Astra
Maths60.871.8GPT-6 Astra
Knowledge63.979.5GPT-6 Astra
Instruction following67.5–not comparable
Human preference59.166.7GPT-6 Astra
Multimodal64.866.0GPT-6 Astra
Long context66.165.4level
Composite49.288.4GPT-6 Astra

Where sources disagree

Across the 45 benchmarks both have, Gemini 3.1 Pro leads 12, GPT-6 Astra leads 33. Independent sources split: Gemini 3.1 Pro leads on Arena Text; GPT-6 Astra leads on BenchLeader Index and AA Intelligence Index v4.3.2.

Overall indexGemini 3.1 ProGPT-6 Astra (max)Leader
BenchLeader Index60.670.4GPT-6 Astra
AA Intelligence Index v4.3.229.752.7GPT-6 Astra
Arena Text14871477Gemini 3.1 Pro

Each publisher runs its own tasks, harnesses and effort settings, so their overall verdicts can differ; BenchLeader reconciles them on one scale. † measured at another effort setting of the same model (the publisher did not test the one compared here).

Price, speed and latency

List prices blended at three input tokens per output token. Per-task prices use the token counts on the methodology page; suite cost is what Artificial Analysis paid to run its whole Intelligence Index.

MeasureGemini 3.1 ProGPT-6 Astra (max)
Blended price per 1M tokens$4.50$20.00
Input / output per 1M$2.00 / $12.00$10.00 / $50.00
Cached input per 1M$0.200$1.00
Price per task: chat reply$0.0044$0.019
Price per task: summarize a 30-page report$0.031$0.150
Price per task: code edit$0.030$0.135
Price per task: agentic coding session$0.168$0.800
Price per task: structured extraction$0.0064$0.030
Cost to run a full benchmark suite$1.30$3.26
Output speed132 tok/s58 tok/s
Time to first answer21.1 s247.0 s
Time to a complete answer24.9 s255.6 s

Per token is not per task: on Artificial Analysis' full suite Gemini 3.1 Pro cost $1.30 and GPT-6 Astra (max) $3.26, because Gemini 3.1 Pro used about 1.8× as many tokens for the same work, which a per-token price hides.

Each model is compared at its best-ranked reasoning-effort setting. Gemini 3.1 Pro scores 60.6 and takes 21 s to its first answer token; Gemini 3.1 Pro (high) scores 60.3 in 21 s. GPT-6 Astra (max) scores 70.4 and takes 247 s to its first answer token; GPT-6 Astra (high) scores 69.6 in 35 s, GPT-6 Astra (xhigh) scores 68.9 in 130 s. Higher effort means more thinking before the answer: better scores, longer waits and more tokens billed. How reasoning effort changes scores and cost.

Every benchmark

180 benchmarks, grouped by category; each name links to the board and its leaders. † measured at another effort setting of the same model, shown for reference and not counted as a win.

MetricPublisherGemini 3.1 ProGPT-6 Astra (max)
BenchLeader IndexBenchLeader60.670.4
Agents & tools scoreBenchLeader57.164.2
Coding scoreBenchLeader57.074.0
Composite scoreBenchLeader49.288.4
Human preference scoreBenchLeader59.166.7
Instruction following scoreBenchLeader67.5–
Knowledge scoreBenchLeader63.979.5
Long context scoreBenchLeader66.165.4
Maths scoreBenchLeader60.871.8
Multimodal scoreBenchLeader64.866.0
Reasoning scoreBenchLeader68.276.2
Blended price $/MBenchLeader$4.50$20.00
Output speedBenchLeader132 tok/s58 tok/s
Time to first answerBenchLeader21.1 s247.0 s
Context windowBenchLeader1,048,576 tokens1,050,000 tokens
Reasoning
GPQA DiamondEpoch AI Benchmarking Hub94.1%95.8%
Humanity's Last ExamScale AI / CAIS46.4%54.8%†
SimpleBenchSimpleBench79.6%–
Arena Hard PromptsArena (LMArena)15081501
LiveBench 2.0 ReasoningLiveBench84.0%92.7%†
LiveBench 1.0 ReasoningLiveBench84.0%†92.7%
GPQA Diamond (AA)Artificial Analysis94.1%96.1%
Humanity's Last Exam (AA)Artificial Analysis47.0%54.7%
GPQA Diamond (Vals)Vals AI95.5%†–
EnigmaEvalScale AI SEAL36.8%†–
ARC-AGI-1ARC Prize98.0%97.5%
ARC-AGI-2ARC Prize77.1%95.0%
ARC-AGI-3ARC Prize0.4%98.6%
CritPtArtificial Analysis17.7%31.7%
MysteryMechanismVals AI20.7%†53.1%
Chess PuzzlesEpoch AI Benchmarking Hub51.0%†74.0%
Mystery Game PuzzlesEpoch AI Benchmarking Hub34.0%†84.0%
CL-benchEpoch AI Benchmarking Hub20.8%–
CL-bench LifeEpoch AI Benchmarking Hub16.9%–
LMCAEpoch AI Benchmarking Hub53.8%†64.1%†
DTBenchEpoch AI Benchmarking Hub95.5%†97.1%†
ForecastBenchForecastBench64.3%–
BTF-3Epoch AI Benchmarking Hub–13.5%†
Coding
SciCodeSciCode58.7%56.5%
WeirdMLWeirdML72.1%93.3%
Show all 180 benchmarks
MetricPublisherGemini 3.1 ProGPT-6 Astra (max)
Coding
FrontierCodeCognition–53.3%
GSO-BenchGSO-Bench22.6%79.4%†
Arena CodingArena (LMArena)15221543
Arena WebDevArena (LMArena)14471775
LiveBench 2.0 CodingLiveBench66.7%93.7%†
LiveBench 1.0 CodingLiveBench76.5%†80.4%
LiveCodeBenchVals AI88.5%†–
IOIVals AI51.8%†100.0%
SWE-bench (Vals)Vals AI78.8%†–
SWE-Bench ProScale AI SEAL46.1%†–
Code MigrationVals AI17.3%†67.7%
Code Migration v1.1Vals AI–80.6%
ProgramBenchVals AI0.0%†5.5%
SWE-bench MultimodalVals AI–43.3%
Vibe Code Bench 1-100Vals AI6.7%†27.6%
Vibe Code Bench v1.1Vals AI32.0%†89.6%
SWE-Bench Pro (private)Scale AI SEAL46.1%†–
SWE Atlas: Codebase QnAScale AI SEAL13.5%59.1%†
SWE Atlas: RefactoringScale AI SEAL33.8%59.0%†
SWE Atlas: Test WritingScale AI SEAL29.8%50.7%†
MirrorCodeEpoch AI Benchmarking Hub8.9%†46.7%†
DeepSWE v1.1Epoch AI Benchmarking Hub11.7%73.2%
ALE-BenchEpoch AI Benchmarking Hub1160.62951.3
AlgoTuneAlgoTune2.0–
FrontierSWEEpoch AI Benchmarking Hub–65.5%
Terminal-Bench 4.0 (AA)Artificial Analysis4.0%59.1%
Terminal-Bench 2.1 (AA)Artificial Analysis73.8%88.4%
Startrise FrontendStartrise–79.9%†
FrontierCode 1.1 (AA)Artificial Analysis–47.0%
Agents & tools
Terminal-BenchTerminal-Bench80.2%58.2%
Remote Labor IndexScale AI / CAIS–20.8%†
APEX-AgentsMercor35.1%64.7%†
Arena AgentArena (LMArena)-3.714.7
LiveBench Long AgenticLiveBench23.9%82.4%†
LiveBench BrowserLiveBench4.0%84.0%†
LiveBench Agentic CodingLiveBench44.1%†57.3%
Terminal-Bench HardArtificial Analysis53.8%–
τ²-Bench Telecom (AA)Artificial Analysis95.6%–
Terminal-Bench 2.1 (Vals)Vals AI70.8%†87.3%
MCP AtlasScale AI SEAL78.2%†–
HiL-BenchScale AI SEAL35.3%65.3%†
τ³-bench Bankingτ²-bench26.0%†–
GDPval-AA v2.1Artificial Analysis14.6%53.7%
τ³-Banking (AA)Artificial Analysis21.4%41.4%
ITBench SRE (AA)Artificial Analysis30.3%48.6%
Analyst Agent (AA)Artificial Analysis41.3%51.3%
APEX-Agents (AA)Artificial Analysis32.0%–
CUA-benchVals AI–19.2%
CyberBenchVals AI–41.1%
Finance Agent v2Vals AI43.0%†53.5%
Finance Agent v2.1Vals AI–60.4%
Harvey's Legal Agent Benchmark v1.1Vals AI–7.1%
Harvey's Legal Agent Benchmark v1Vals AI0.0%†5.4%
Legal Research BenchVals AI20.7%†39.4%
Robo-benchVals AI–23.3%
SREBenchVals AI0.0%†56.9%
Tax Agent BenchVals AI9.3%†20.7%
Terminal-Bench 2.0 (Vals)Vals AI67.4%†–
Terminal-Bench 4.0 (Vals)Vals AI2.5%†59.6%
Terminal-Bench ScienceVals AI1.4%†62.9%
Time Horizon Index: KSPVals AI–90.5%
Arena SearchArena (LMArena)–1246
BALROGBALROG57.0%68.3%
DeepResearch BenchDeepResearch Bench47.8%†–
PostTrainBenchEpoch AI Benchmarking Hub22.0%–
ExploitBenchEpoch AI Benchmarking Hub26.1%–
METR Time HorizonsMETR77.0%–
GBAEvalEpoch AI Benchmarking Hub0.8%–
Vending-Bench 2Andon Labs911.215514.7†
AutomationBenchArtificial Analysis35.4%68.5%
GDP.pdf (AA)Artificial Analysis17.8%31.0%
Harvey LAB-AA v1.1Harvey0.0%8.6%
EnterpriseOps-GymArtificial Analysis42.2%–
AA-Briefcase v1.1Artificial Analysis4561568
Terminal-Bench-Science 0.1 (AA)Artificial Analysis–63.3%
CWE-Bench (AA)Artificial Analysis–63.3%
DeepSec-Bench (AA)Artificial Analysis–36.9%
CyberGym end-to-end (AA)Artificial Analysis–0.0%
BrowseCompOpenAI31.2%–
DeepSearchQAGoogle60.2%–
FACTS SearchGoogle83.7%89.9%†
Maths
FrontierMath Tiers 1–3Epoch AI Benchmarking Hub59.6%93.7%
FrontierMath Tier 4Epoch AI Benchmarking Hub26.8%97.6%
OTIS Mock AIMEEpoch AI Benchmarking Hub95.6%100.0%
ProofBenchVals AI26.0%99.0%†
LiveBench MathematicsLiveBench91.0%†96.8%
AIME (Vals)Vals AI98.1%†–
AIME 2026MathArena98.3%–
HMMT February 2026MathArena94.7%–
USAMO 2026MathArena74.4%–
MathArena ApexMathArena60.9%–
Arena MathsArena (LMArena)14891487
Knowledge
SimpleQA VerifiedEpoch AI Benchmarking Hub73.5%†75.6%
LiveBench 2.0 Data AnalysisLiveBench78.5%83.0%†
LiveBench ResearchLiveBench65.7%85.2%†
LiveBench 1.0 Data AnalysisLiveBench78.5%†83.0%
AA-OmniscienceArtificial Analysis31.943.4
MMLU-ProVals AI91.0%†–
LegalBenchVals AI87.4%†–
CorpFinVals AI64.5%†–
TaxEvalVals AI72.9%†–
MedQAVals AI96.4%†–
PRBench FinanceScale AI SEAL41.9%47.5%†
PRBench LegalScale AI SEAL44.0%48.4%†
MultiNRCScale AI SEAL64.7%–
BioMysteryBenchVals AI60.0%†79.3%
CaseLaw v2Vals AI64.8%†–
Excel Modeling BenchmarkVals AI52.6%†71.7%
Excel Modeling Benchmark v1.1Vals AI–72.7%
MedCodeVals AI59.1%†48.5%
MedScribeVals AI76.1%†87.9%
Public Benefits Bench v1.1Vals AI53.8%†–
DrugDiscoveryBenchScale AI SEAL41.9%†68.7%
EBR-benchEpoch AI Benchmarking Hub14.3%76.2%
GDP.pdfEpoch AI Benchmarking Hub17.0%34.2%
AA-Omniscience: accuracyArtificial Analysis54.9%62.6%
AA-Omniscience: non-hallucinationArtificial Analysis49.1%48.7%
Global-MMLU-Lite (AA)Artificial Analysis93.2%–
Instruction following
LiveBench LanguageLiveBench85.4%†89.4%
LiveBench Instruction FollowingLiveBench79.1%†75.6%
IFBenchArtificial Analysis77.1%–
MultiChallengeScale AI SEAL71.4%–
TutorBenchScale AI SEAL53.0%–
Arena Instruction FollowingArena (LMArena)14801473
Human preference
Arena TextArena (LMArena)14871477
EQ-Bench 4EQ-Bench1142–
Arena Creative WritingArena (LMArena)14811450
Arena Multi-turnArena (LMArena)14961485
Arena Longer QueriesArena (LMArena)14991489
Multimodal
Arena VisionArena (LMArena)12961280
LiveBench DesignLiveBench61.6%82.0%†
MMMU-ProArtificial Analysis82.4%86.9%
MMMU-Pro (official)MMMU80.5%†–
MMMU-Pro (Vals)Vals AI88.2%†–
MortgageTaxVals AI69.4%†–
SAGEVals AI48.7%†46.4%
VTBScale AI SEAL29.0%–
Blueprint-Bench 2Epoch AI Benchmarking Hub26.5%49.7%†
AA-3DArtificial Analysis–1166
Long context
AA-LCRArtificial Analysis82.0%80.7%
Arena DocumentArena (LMArena)14591473
MLCRArtificial Analysis11.1%41.7%
Composite
Epoch Capabilities IndexEpoch AI Benchmarking Hub155.3168.8†
LiveBench 2.0LiveBench54.9%86.1%†
LiveBench 1.0LiveBench77.0%†82.2%
AA Intelligence Index v4.3.2Artificial Analysis29.752.7
Vals IndexVals AI–65.0
Vals Finance IndexVals AI–55.6%
Vals RSI IndexVals AI–27.1%
Vals Science IndexVals AI27.4%†65.1%
Vals Multimodal IndexVals AI56.1%†–
Vals Router IndexVals AI–65.0%†
AA Cyber IndexArtificial Analysis–33.4
Safety & honesty
FORTRESSScale AI SEAL29.8%–
MASKScale AI SEAL42.4%–

Data as of 2026-10-24. Best configuration of each model; every score links to its source on the model pages.

What changed

  • GPT-6 Astra (max): 9 new results (Code Migration v1.1, Excel Modeling Benchmark v1.1, Finance Agent v2.1…).
  • Gemini 3.1 Pro: 2 score revisions.
  • GPT-6 Astra (max): 1 score revision.
  • Gemini 3.1 Pro: 1 score revision.
  • GPT-6 Astra (max): 4 score revisions.
  • Gemini 3.1 Pro: BenchLeader Index 62.4 → 60.7.
  • GPT-6 Astra (max): BenchLeader Index 69.8 → 70.6.
  • Gemini 3.1 Pro: 8 new results (LiveBench 2.0, LiveBench Long Agentic, LiveBench 2.0 Reasoning…).
  • Gemini 3.1 Pro: 1 new result (USAMO 2026).
  • Gemini 3.1 Pro: 1 score revision.

Rankings: Best LLM overall · Best LLM for coding · Best LLM for agents · Best cheap LLMs

Gemini 3.1 Pro vs GPT-6 Astra: questions

Is Gemini 3.1 Pro better than GPT-6 Astra?
GPT-6 Astra (max) leads on quality: 70.4 vs 60.6. The BenchLeader Index combines every independent quality benchmark; GPT-6 Astra (max) is ahead overall as of 2026-10-24, but check the category scores for your use.
Which is cheaper, Gemini 3.1 Pro or GPT-6 Astra, and will that change?
Gemini 3.1 Pro is cheaper today: $4.50 against $20.00 per million tokens, blended at three input tokens per output token. No price change has been announced for either.
Is Gemini 3.1 Pro better than GPT-6 Astra for coding?
GPT-6 Astra scores higher in coding (74 vs 57 on the category index, where 50 is average). On Arena WebDev, the top shared coding benchmark, it is 1447 for Gemini 3.1 Pro against 1775 for GPT-6 Astra.
Is Gemini 3.1 Pro better than GPT-6 Astra for agents and tool use?
GPT-6 Astra scores higher in agentic tasks (64 vs 57 on the category index, where 50 is average). On Terminal-Bench, the top shared agents & tools benchmark, it is 80.2% for Gemini 3.1 Pro against 58.2% for GPT-6 Astra.
Which is better for long documents?
They are level on long-context benchmarks (66 vs 65). Both take about 1.1M tokens: Gemini 3.1 Pro 1,048,576, GPT-6 Astra 1,050,000.
Which has lower latency?
Gemini 3.1 Pro answers first: 21.1 s against 247.0 s to the first answer token, as Artificial Analysis measures it. Reasoning effort drives most of this: a higher setting thinks longer before it answers.
Which is faster, Gemini 3.1 Pro or GPT-6 Astra?
Gemini 3.1 Pro streams faster: 132 against 58 output tokens per second.
Do independent benchmarks agree on Gemini 3.1 Pro vs GPT-6 Astra?
Across the 45 benchmarks both have, Gemini 3.1 Pro leads 12, GPT-6 Astra leads 33. Independent sources split: Gemini 3.1 Pro leads on Arena Text; GPT-6 Astra leads on BenchLeader Index and AA Intelligence Index v4.3.2.
When was GPT-6 Astra released?
GPT-6 Astra was released on 2 Sept 2026.