BenchLeader

Time per task: summarize a 30-page report

12,000 tokens of document in, a 600-token summary out. Time = time to first answer + output tokens ÷ output speed.

As of 25 Oct 2026, BenchLeader ranks Celeris-1 first on the Time per task: summarize a 30-page report board at 0.9 s, ahead of Gemini 2.5 Flash-Lite (2.4 s) and DeepSeek V4.1 Flash (2.9 s).

520 models · data as of 25 Oct 2026

244 of 244
#
1Ling Flash 2.02.4 min44.4
2DeepSeek V4 Flash 0420max2.2 min57.0
3Qwen3.6 Plus1.9 min58.8
4GPT-5.4 Pro1.5 min63.3
5DeepSeek R1 05281.3 min49.5
6Seed-OSS-36B-Instruct1.2 min46.8
7GPT-5.3-Codexxhigh1.1 min63.8
8Qwen3.8 2.4T A95B1.1 min61.0
9MiniMax M2.757.8 s55.6
10Qwen3.5-4Bno reasoning55.0 s42.2
11Qwen3.8-Flash-Next52.6 s60.3
12MiMo-V2.6-Pro50.2 s64.0
13Claude Opus 4.1thinking50.1 s56.4
14Kimi K2.7 Code50.0 s55.8
15MiMo-V2.6-Flash47.9 s59.7
16Ling 3.0 Tiny47.9 s48.7
17Qwen3.7 Plus46.2 s58.5
18North Mini Code43.6 s45.9
19Grok Build 0.141.5 s54.8
20MiniMax M2.541.4 s53.6
21GLM 5.3 Flash41.1 s62.7
22MiniMax-M2.140.1 s53.8
23Grok 3 minithinking39.7 s49.4
24NewKimi K3.1 Pro38.4 s66.9
25DeepSeek V3.237.4 s56.6
26LongCat 2.036.6 s49.4
27GLM-4.5-Air36.4 s46.6
28MiMo-V2.535.9 s54.3
29Granite 4.2 30B35.6 s48.7
30Magistral Small 1.234.7 s40.3
31GLM 5 Turbo33.7 s55.5
32GPT-5.5 Proxhigh33.6 s65.3
33GLM 5.3low32.3 s55.6
34Reka Flash 331.0 s38.9
35GLM-4.530.8 s51.7
36Granite 4.2 8B30.7 s46.1
37Mistral Large 430.6 s56.7
38MiniMax M330.6 s56.4
39o4-minihigh29.3 s50.1
40MiniMax-M129.2 s47.5
41NewMiniMax M3.1 Flash28.5 s61.9
42Granite 3.3 8Bno reasoning28.0 s39.2
43MiniMax-M227.6 s50.8
44Llama 3.2 Instruct 11B (Vision)27.5 s36.5
45Gemini 2.5 Pro27.4 s53.9
46Granite 4.2 3B26.9 s44.8
47Qwen2.5 72B25.8 s42.2
48Gemini 3.1 Pro25.6 s60.5
49Ring-2.6-1T25.3 s49.3
50Mixtral 8x7B25.1 s31.7
51Qwen3 VL 30B A3B Instructthinking24.8 s44.0
52Agnes 2.5 Pro Beta24.4 s59.1
53DeepSeek V3.1thinking24.4 s48.1
54Gemma 3 27B23.9 s38.9
55Kimi K2 Thinkingthinking23.4 s52.4
56GLM-4.6no reasoning22.4 s46.7
57Qwen2.5 Coder 32B Instruct21.6 s42.1
58DeepSeek R121.5 s46.8
59Step 3.5 Flash21.3 s53.7
60GPT-4 Turbo21.2 s40.9

Cite as: BenchLeader, “Time per task: summarize a 30-page report”, data as of 25 Oct 2026, https://www.benchleader.com/leaderboards/time-summarize-report.