BenchLeader

WeirdML v3 leaderboard

As of 16 Nov 2026, the top score on WeirdML v3 is 42.2% by GPT-6 Astra (OpenAI), ahead of GPT-6.1 Sol at 38.3%, across 26 model configurations with a published result (WeirdML, result dated 3 Sep 2026). Eleven unusual machine-learning tasks solved by a coding agent that writes and runs its own training code. The leaderboard's official score rewards reaching a good result in few tokens as well as the result itself; not comparable with WeirdML v2. WeirdML v3 is shown for reference only and does not count toward the BenchLeader Index.

Key facts (as of 16 Nov 2026)

  • GPT-6 Astra holds the top WeirdML v3 score at 42.2% (WeirdML, 3 Sep 2026).
  • GPT-6.1 Sol is second on WeirdML v3 at 38.3% (WeirdML, 29 Sep 2026).
  • WeirdML v3: Eleven unusual machine-learning tasks solved by a coding agent that writes and runs its own training code. The leaderboard's official score rewards reaching a good result in few tokens as well as the result itself; not comparable with WeirdML v2 (WeirdML).
  • 26 model configurations have a published WeirdML v3 result on BenchLeader (BenchLeader, 16 Nov 2026).
  • WeirdML v3 does not feed the BenchLeader Index; it is shown for reference (BenchLeader methodology).

Eleven unusual machine-learning tasks solved by a coding agent that writes and runs its own training code. The leaderboard's official score rewards reaching a good result in few tokens as well as the result itself; not comparable with WeirdML v2.

Published by
WeirdMLdata via Epoch AI Benchmarking Hub
Category
Coding
Index weight
Reference only
Models
26
Data as of
16 Nov 2026
Newest result
26 Oct 2026

CC BY 4.0 — Epoch AI, ‘AI Benchmarking Hub’, epoch.ai/benchmarks. Mirrored boards credit their original publishers.

26 of 26
#
1GPT-6 Astraxhigh42.2%66.02026-09-03
2GPT-6.1 Solxhigh38.3%63.62026-09-29
3Claude Opus 5.5xhigh31.2%65.42026-09-22
4GPT-6.1 Terraxhigh28.1%60.02026-10-26
5Claude Fable 5.1xhigh26.0%64.62026-09-01
6Gemini 4 Argonhigh20.3%65.32026-10-13
7Claude Sonnet 5.5xhigh19.9%62.52026-09-28
8GPT-6 Solxhigh19.7%58.42026-09-22
9Claude Opus 5xhigh19.0%60.12026-07-24
10Claude Fable 5xhigh15.6%–2026-06-09
11Muse Wonderxhigh15.2%–2026-10-12
12GPT-5.6 Solxhigh15.0%63.92026-07-09
13Claude Haiku 5.5xhigh11.7%56.72026-10-07
14Kimi K3.1 Proxhigh9.9%–2026-10-23
15DeepSeek V4.1 Flash 1017high9.2%51.22026-10-17
16Grok 4.7xhigh8.4%57.42026-09-21
17GPT-6 Lunaxhigh7.9%52.02026-09-22
18Kimi K3high7.5%–2026-07-16
19Gemini 3.8 Flashhigh7.4%59.42026-09-02
20Muse Spark 1.3xhigh6.7%58.12026-09-02
21Claude Opus 4.5high6.5%59.72025-11-24
22DeepSeek V4.1 Flashhigh6.0%55.62026-09-09
23GPT-5.6 Lunaxhigh5.2%58.22026-07-09
24GPT-5.2xhigh5.0%59.92025-12-11
25Mistral Large 4high4.5%48.32026-10-06
26Inklingxhigh3.9%50.02026-07-15

AI coding benchmark leaderboard · All LLM benchmarks

Cite as: BenchLeader, “WeirdML v3 leaderboard”, data as of 16 Nov 2026, https://www.benchleader.com/benchmarks/weirdml_v3.

WeirdML v3: questions

What does WeirdML v3 measure?
Eleven unusual machine-learning tasks solved by a coding agent that writes and runs its own training code. The leaderboard's official score rewards reaching a good result in few tokens as well as the result itself; not comparable with WeirdML v2. Scores are reported in percent of tasks solved; higher is better.
What is the top score on WeirdML v3?
As of 16 Nov 2026, the highest score on WeirdML v3 is 42.2% by GPT-6 Astra (result dated 3 Sep 2026), ahead of GPT-6.1 Sol at 38.3%. Scores come from WeirdML and are re-read daily.
Which AI model leads WeirdML v3?
GPT-6 Astra leads WeirdML v3 with 42.2% as of 16 Nov 2026 (result dated 3 Sep 2026), ahead of GPT-6.1 Sol at 38.3%.
How many models have WeirdML v3 results?
26 model configurations have a WeirdML v3 result on BenchLeader, all taken from WeirdML via Epoch AI Benchmarking Hub.
Who runs WeirdML v3 and how often is it updated?
WeirdML v3 is published by WeirdML. BenchLeader re-reads the published results once a day and records the date each result was published.
Does WeirdML v3 count toward the BenchLeader Index?
No. WeirdML v3 is shown for reference but left out of the composite index.