Time per task: agentic coding session
One long tool-using loop: 60,000 tokens in across turns, 4,000 tokens out. Time = time to first answer + output tokens ÷ output speed.
As of 25 Oct 2026, BenchLeader ranks Celeris-1 first on the Time per task: agentic coding session board at 3.1 s, ahead of K2 Horizon 375B A23B (8.7 s) and Mercury 2.5 (9.5 s).
520 models · data as of 25 Oct 2026
- 1Celeris-13.1 s
- 2K2 Horizon 375B A23B8.7 s
- 3Mercury 2.59.5 s
- 4Gemini 2.5 Flash-Lite (none)13.9 s
- 5DeepSeek V4.1 Flash (none)14.4 s
- 6Gemini 3.1 Flash Lite14.8 s
- 7Nova Micro15.2 s
- 8Nemotron 3 Nano 30B A3B (none)15.7 s
- 9Gemini 3.5 Flash Lite16.2 s
- 10Mercury 216.7 s
- 11Qwen3 Coder 30B A3B Instruct17.5 s
- 12Trinity Large (thinking)18.1 s
- 13Grok 4.20 Multi-Agent18.5 s
- 14Beam 1.018.6 s
- 15GPT-4.1 nano18.6 s
244 of 244
Cite as: BenchLeader, “Time per task: agentic coding session”, data as of 25 Oct 2026, https://www.benchleader.com/leaderboards/time-agent-session.