BenchLeader

SWE-bench Multilingual (bash only) leaderboard

As of 16 Nov 2026, the top score on SWE-bench Multilingual (bash only) is 72.7% by Gemini 3 Flash (Google), ahead of Claude Opus 4.6 at 72.0%, across 13 model configurations with a published result (SWE-bench, result dated 13 Feb 2026). 300 real GitHub issues from 42 repositories in nine programming languages, run by the SWE-bench team in the minimal bash-only mini-SWE-agent harness. SWE-bench Multilingual (bash only) is shown for reference only and does not count toward the BenchLeader Index.

Key facts (as of 16 Nov 2026)

  • Gemini 3 Flash holds the top SWE-bench Multilingual (bash only) score at 72.7% (SWE-bench, 13 Feb 2026).
  • Claude Opus 4.6 is second on SWE-bench Multilingual (bash only) at 72.0% (SWE-bench, 13 Feb 2026).
  • SWE-bench Multilingual (bash only): 300 real GitHub issues from 42 repositories in nine programming languages, run by the SWE-bench team in the minimal bash-only mini-SWE-agent harness (SWE-bench).
  • 13 model configurations have a published SWE-bench Multilingual (bash only) result on BenchLeader (BenchLeader, 16 Nov 2026).
  • SWE-bench Multilingual (bash only) does not feed the BenchLeader Index; it is shown for reference (BenchLeader methodology).

300 real GitHub issues from 42 repositories in nine programming languages, run by the SWE-bench team in the minimal bash-only mini-SWE-agent harness.

Published by
SWE-bench
Category
Coding
Index weight
Reference only
Models
13
Data as of
16 Nov 2026
Newest result
20 Feb 2026

The publisher has posted no new results on this board since 20 Feb 2026. BenchLeader re-reads it every day, so newer models appear here as soon as they are published.

SWE-bench (Jimenez et al. 2024), swebench.com.

13 of 13
#
1Gemini 3 Flash72.7%56.5mini-SWE-agent$105.552026-02-13
2Claude Opus 4.672.0%62.1mini-SWE-agent$198.892026-02-13
3Claude Opus 4.570.7%57.1mini-SWE-agent$250.072026-02-13
4GLM-569.7%54.9mini-SWE-agent$192.742026-02-13
5Gemini 3 Pro68.7%60.0mini-SWE-agent$306.332026-02-13
6MiniMax M2.568.3%53.7mini-SWE-agent$30.062026-02-16
7Kimi K2.567.3%54.6mini-SWE-agent$207.852026-02-13
8Claude Sonnet 4.567.0%53.8mini-SWE-agent$200.862026-02-13
9GPT-5.2high66.7%55.8mini-SWE-agent$160.922026-02-13
10GPT-5.2-Codex66.3%57.6mini-SWE-agent$198.652026-02-20
11Claude Haiku 4.564.7%47.7mini-SWE-agent$113.852026-02-13
12DeepSeek V3.259.0%50.2mini-SWE-agent$115.152026-02-13
13GPT-5 mini39.7%56.6mini-SWE-agent$15.492026-02-13

AI coding benchmark leaderboard · All LLM benchmarks

Cite as: BenchLeader, “SWE-bench Multilingual (bash only) leaderboard”, data as of 16 Nov 2026, https://www.benchleader.com/benchmarks/swe_bench_multilingual.

SWE-bench Multilingual (bash only): questions

What does SWE-bench Multilingual (bash only) measure?
300 real GitHub issues from 42 repositories in nine programming languages, run by the SWE-bench team in the minimal bash-only mini-SWE-agent harness. Scores are reported in percent of tasks solved; higher is better.
What is the top score on SWE-bench Multilingual (bash only)?
As of 16 Nov 2026, the highest score on SWE-bench Multilingual (bash only) is 72.7% by Gemini 3 Flash (result dated 13 Feb 2026), ahead of Claude Opus 4.6 at 72.0%. Scores come from SWE-bench and are re-read daily.
Which AI model leads SWE-bench Multilingual (bash only)?
Gemini 3 Flash leads SWE-bench Multilingual (bash only) with 72.7% as of 16 Nov 2026 (result dated 13 Feb 2026), ahead of Claude Opus 4.6 at 72.0%.
How many models have SWE-bench Multilingual (bash only) results?
13 model configurations have a SWE-bench Multilingual (bash only) result on BenchLeader, all taken from SWE-bench.
Who runs SWE-bench Multilingual (bash only) and how often is it updated?
SWE-bench Multilingual (bash only) is published by SWE-bench. BenchLeader re-reads the published results once a day and records the date each result was published.
Does SWE-bench Multilingual (bash only) count toward the BenchLeader Index?
No. SWE-bench Multilingual (bash only) is shown for reference but left out of the composite index.