BenchLeader

GPT-6 Astra vs Grok 4.20

Verdict
  • GPT-6 Astra (high) leads on quality: 71.9 vs 59.9.
  • GPT-6 Astra (high) is stronger in agents & tools, coding, composite, knowledge, long context, maths, multimodal, reasoning.
  • Grok 4.20 (thinking) is stronger in human preference, instruction following.
  • Grok 4.20 (thinking) is 13× cheaper ($1.56 vs $20.00 per 1M blended).
  • Grok 4.20 (thinking) streams 2.1× faster (101 vs 47 tokens per second).
MetricGPT-6 Astra (high)Grok 4.20 (thinking)
BenchLeader Index71.959.9
Agents & tools score64.951.7
Coding score72.854.7
Composite score93.861.5
Knowledge score85.156.8
Long context score66.560.7
Maths score79.555.6
Multimodal score71.259.9
Reasoning score81.960.7
Human preference score67.1
Instruction following score79.9
Blended price $/M$20.00$1.56
Output speed47 tok/s101 tok/s
Time to first answer49.2 s21.4 s
Context window1.1M1M
GPQA Diamond89.3%
FrontierMath Tiers 1–344.9%
FrontierMath Tier 497.6%17.1%
OTIS Mock AIME92.2%
SimpleQA Verified30.2%
Terminal-Bench57.9%
SciCode55.4%
WeirdML92.9%
ProofBench14.0%
LMArena Text1472
LMArena Hard Prompts1488
LMArena Coding1510
LMArena WebDev1374
LMArena Vision1263
AA Intelligence Index51.025.7
IFBench82.9%
AA-LCR80.0%69.0%
MMMU-Pro86.4%74.6%
AA-Omniscience43.714.8
Terminal-Bench Hard40.9%
GPQA Diamond (AA)95.0%91.1%
Humanity's Last Exam (AA)53.1%34.5%
SciCode (AA)55.4%
τ²-Bench Telecom (AA)96.5%
AIME (Vals)96.5%
LiveCodeBench84.3%
MMLU-Pro86.3%
LegalBench77.7%
CorpFin63.7%
TaxEval74.1%
MedQA94.5%
Terminal-Bench 2.1 (Vals)44.2%
SWE-bench (Vals)72.2%
GPQA Diamond (Vals)88.6%
Vals Index17.6
Kagi LLM Benchmark75.0%
ARC-AGI-198.5%89.5%
ARC-AGI-292.1%65.1%
ARC-AGI-399.9%0.1%
CritPt28.9%6.6%
GDPval (AA)51.5%
τ²-Bench Banking (AA)40.0%
APEX-Agents (AA)14.2%
CaseLaw v254.5%
Code Migration0.3%
Excel Modeling Benchmark11.7%
Finance Agent v228.5%
Harvey's Legal Agent Benchmark0.0%
Legal Research Bench13.9%
MedCode32.2%
MedScribe63.4%
MMMU-Pro (Vals)83.5%
MortgageTax45.4%
SAGE38.2%
Terminal-Bench 2.0 (Vals)40.5%
Vals Multimodal Index39.1%
Vibe Code Bench v1.14.1%
LMArena Maths1467
LMArena Creative Writing1446
LMArena Instruction Following1445
LMArena Multi-turn1480
LMArena Longer Queries1465
LMArena Document1439
Chess Puzzles24.0%
MirrorCode46.7%
DeepSWE73.2%
ForecastBench60.7%

Data as of 2026-09-19. Best configuration of each model; every score links to its source on the model pages.

GPT-6 Astra vs Grok 4.20: questions

Is GPT-6 Astra better than Grok 4.20?
GPT-6 Astra (high) leads on quality: 71.9 vs 59.9. The BenchLeader Index combines every independent quality benchmark; GPT-6 Astra (high) is ahead overall as of 2026-09-19, but check the category scores for your use.
Is GPT-6 Astra better than Grok 4.20 for coding?
GPT-6 Astra scores higher in coding (73 vs 55 on the category index, where 50 is average).
Is GPT-6 Astra better than Grok 4.20 for agentic tasks?
GPT-6 Astra scores higher in agentic tasks (65 vs 52 on the category index, where 50 is average).
Which is cheaper, GPT-6 Astra or Grok 4.20?
Grok 4.20 is cheaper: $1.56 against $20.00 per million tokens, blended at three input tokens per output token.
Which is faster, GPT-6 Astra or Grok 4.20?
Grok 4.20 streams faster: 101 against 47 output tokens per second.
Which has the larger context window?
GPT-6 Astra accepts more context: 1.1M against 1M tokens.