PropensityBench leaderboard
As of 6 Nov 2026, the top score on PropensityBench is 79.0% by Gemini 2.5 Pro (Google), ahead of Gemini 2.0 Flash at 77.8%, across 14 model configurations with a published result (Scale AI SEAL, result dated 31 Oct 2025). Agents are placed in scenarios where a harmful shortcut is available and pressure rises; the score is how often they take it. PropensityBench is shown for reference only and does not count toward the BenchLeader Index.
Key facts (as of 6 Nov 2026)
- Gemini 2.5 Pro holds the top PropensityBench score at 79.0% (Scale AI SEAL, 31 Oct 2025).
- Gemini 2.0 Flash is second on PropensityBench at 77.8% (Scale AI SEAL, 31 Oct 2025).
- PropensityBench: How readily an agent takes harmful actions when pressured in agentic settings. Scale AI (Scale AI SEAL).
- 14 model configurations have a published PropensityBench result on BenchLeader (BenchLeader, 6 Nov 2026).
- PropensityBench does not feed the BenchLeader Index; it is shown for reference (BenchLeader methodology).
How readily an agent takes harmful actions when pressured in agentic settings. Scale AI.
- Published by
- Scale AI SEAL
- Category
- Safety & honesty
- Index weight
- Reference only
- Models
- 14
- Data as of
- 6 Nov 2026
Scale AI SEAL Leaderboards.
What the test looks like
Agents are placed in scenarios where a harmful shortcut is available and pressure rises; the score is how often they take it.
How it is scored
Propensity score, published by Scale AI.
What to keep in mind
A safety measure where lower propensity is better; not part of the index.
- 1Gemini 2.5 Pro79.0%
- 2Gemini 2.0 Flash77.8%
- 3Qwen3 8B75.2%
- 4Gemini 2.5 Flash68.0%
- 5Llama 3.1 8B66.5%
- 6Llama 3.1 70B55.4%
- 7Gemini 3 Pro52.9%
- 8GPT-4o46.1%
- 9GPT-5.234.4%
- 10o3-mini33.2%
- 11Qwen2.5 32B Instruct22.9%
- 12o4-mini15.8%
- 13Claude Sonnet 412.2%
- 14o310.5%
| # | ||||
|---|---|---|---|---|
| 1 |  Gemini 2.5 Pro | 79.0% | 54.5 | 2025-10-31 |
| 2 | Gemini 2.0 Flash | 77.8% | 43.5 | 2025-10-31 |
| 3 |  Qwen3 8Bopen ↗ | 75.2% | – | 2025-10-31 |
| 4 | Gemini 2.5 Flash | 68.0% | 52.7 | 2025-10-31 |
| 5 |  Llama 3.1 8Bopen ↗ | 66.5% | 33.7 | 2025-10-31 |
| 6 | Llama 3.1 70Bopen ↗ | 55.4% | 40.8 | 2025-10-31 |
| 7 | Gemini 3 Pro | 52.9% | 60.2 | 2026-01-15 |
| 8 |  GPT-4o | 46.1% | 43.3 | 2025-10-31 |
| 9 | GPT-5.2 | 34.4% | 57.9 | 2026-01-15 |
| 10 | o3-mini | 33.2% | 50.7 | 2025-10-31 |
| 11 | Qwen2.5 32B Instructopen ↗ | 22.9% | – | 2025-10-31 |
| 12 | o4-mini | 15.8% | 56.9 | 2025-10-31 |
| 13 |  Claude Sonnet 4 | 12.2% | 50.5 | 2025-10-31 |
| 14 | o3 | 10.5% | 61.0 | 2025-10-31 |
More safety & honesty benchmarks · All LLM benchmarks
Cite as: BenchLeader, “PropensityBench leaderboard”, data as of 6 Nov 2026, https://www.benchleader.com/benchmarks/scale_propensitybench.
PropensityBench: questions
- What does PropensityBench measure?
- Agents are placed in scenarios where a harmful shortcut is available and pressure rises; the score is how often they take it. Scores are reported in percent of tasks solved; higher is better.
- What is the top score on PropensityBench?
- As of 6 Nov 2026, the highest score on PropensityBench is 79.0% by Gemini 2.5 Pro (result dated 31 Oct 2025), ahead of Gemini 2.0 Flash at 77.8%. Scores come from Scale AI SEAL and are re-read daily.
- Which AI model leads PropensityBench?
- Gemini 2.5 Pro leads PropensityBench with 79.0% as of 6 Nov 2026 (result dated 31 Oct 2025), ahead of Gemini 2.0 Flash at 77.8%.
- How many models have PropensityBench results?
- 14 model configurations have a PropensityBench result on BenchLeader, all taken from Scale AI SEAL.
- Who runs PropensityBench and how often is it updated?
- PropensityBench is published by Scale AI SEAL. BenchLeader re-reads the published results once a day and records the date each result was published.
- Does PropensityBench count toward the BenchLeader Index?
- No. PropensityBench is shown for reference but left out of the composite index.