BenchLeader

BrokenArXiv leaderboard

As of 16 Nov 2026, the top score on BrokenArXiv is 84.4% by Gemini 4 Carbon (Google), ahead of GPT-6.1 Sol at 83.1%, across 8 model configurations with a published result (MathArena). Statements from recent arXiv papers altered slightly so they are false: a model scores when it points out the flaw instead of 'proving' it. MathArena. Shown for reference; few models so far. BrokenArXiv is shown for reference only and does not count toward the BenchLeader Index.

Key facts (as of 16 Nov 2026)

  • Gemini 4 Carbon holds the top BrokenArXiv score at 84.4% (MathArena, 16 Nov 2026).
  • GPT-6.1 Sol is second on BrokenArXiv at 83.1% (MathArena, 16 Nov 2026).
  • BrokenArXiv: Statements from recent arXiv papers altered slightly so they are false: a model scores when it points out the flaw instead of 'proving' it. MathArena. Shown for reference; few models so far (MathArena).
  • 8 model configurations have a published BrokenArXiv result on BenchLeader (BenchLeader, 16 Nov 2026).
  • BrokenArXiv does not feed the BenchLeader Index; it is shown for reference (BenchLeader methodology).

Statements from recent arXiv papers altered slightly so they are false: a model scores when it points out the flaw instead of 'proving' it. MathArena. Shown for reference; few models so far.

Published by
MathArena
Category
Maths
Index weight
Reference only
Models
8
Data as of
16 Nov 2026

MIT — eth-sri/matharena.

8 of 8
#
1Gemini 4 Carbonhigh84.4%68.9$16.35540k
2GPT-6.1 Solmax83.1%66.6$1.1480k
3Claude Opus 5.5high77.3%66.0$2.6686k
4Inkling 2 Small63.2%57.9$0.220128k
5Kimi K3.1 Promax61.9%59.9$2.35125k
6DeepSeek V4.1 Flash 1017max48.7%57.7$0.290184k
7Gemini 4 Argonhigh47.9%65.3$9.55524k
8Muse Spark Openxhigh30.1%53.5$0.45056k

AI reasoning and math benchmark leaderboard · All LLM benchmarks

Cite as: BenchLeader, “BrokenArXiv leaderboard”, data as of 16 Nov 2026, https://www.benchleader.com/benchmarks/matharena_brokenarxiv.

BrokenArXiv: questions

What does BrokenArXiv measure?
Statements from recent arXiv papers altered slightly so they are false: a model scores when it points out the flaw instead of 'proving' it. MathArena. Shown for reference; few models so far. Scores are reported in percent of tasks solved; higher is better.
What is the top score on BrokenArXiv?
As of 16 Nov 2026, the highest score on BrokenArXiv is 84.4% by Gemini 4 Carbon, ahead of GPT-6.1 Sol at 83.1%. Scores come from MathArena and are re-read daily.
Which AI model leads BrokenArXiv?
Gemini 4 Carbon leads BrokenArXiv with 84.4% as of 16 Nov 2026, ahead of GPT-6.1 Sol at 83.1%.
How many models have BrokenArXiv results?
8 model configurations have a BrokenArXiv result on BenchLeader, all taken from MathArena.
Who runs BrokenArXiv and how often is it updated?
BrokenArXiv is published by MathArena. BenchLeader re-reads the published results once a day and records the date each result was published.
Does BrokenArXiv count toward the BenchLeader Index?
No. BrokenArXiv is shown for reference but left out of the composite index.