Time per task: code edit

6,000 tokens of files and instructions in, a 1,500-token diff out. Time = time to first answer + output tokens ÷ output speed.

426 models · data as of 9 Sept 2026

1. 1Gemini 2.5 Flash-Lite5.5 s
2. 2Gemini 3.7 Flash5.6 s
3. 3Mercury 26.1 s
4. 4Nova Micro6.4 s
5. 5Gemini 2.5 Flash8.2 s
6. 6Qwen3.5 Omni Flash8.2 s
7. 7Gemini 3 Flash8.3 s
8. 8Gemini 3 Flash8.3 s
9. 9Gemini 3 Flash8.3 s
10. 10Ministral 3 3B8.8 s
11. 11Gemini 3.5 Flash9.0 s
12. 12Amazon Nova Lite9.7 s
13. 13Muse Spark 1.19.8 s
14. 14Muse Spark 1.19.8 s
15. 15GPT-5 nano9.8 s

SearchAll providersAlibabaAmazonAnt GroupAnt-groupAnthropicArcee AICohereDeepSeekGoogleIBMInceptionInclusionAIMetaMicrosoftMiniMaxMistral AIMoonshot AIMultiverse ComputingNous ResearchNVIDIAOpenAIStepFunThinking MachinesUpstagexAIXiaomiZhipu AIOpen weights426 of 426

#	Model	seconds ↓	Index ↕
1	GPT-5.4 ProOpenAI	25.1 min	64.2
2	GPT-5.4 ProOpenAI	25.1 min	61.1
3	GPT-6 AstraOpenAI	5.9 min	70.6
4	GPT-6 AstraOpenAI	5.9 min	69.9
5	GPT-6 AstraOpenAI	5.9 min	64.4
6	Claude Fable 5.1Anthropic	5.1 min	70.2
7	Claude Fable 5.1Anthropic	5.1 min	70.0
8	Gemma 3 12B ITNVIDIAopen	5.0 min	37.2
9	GPT-6 AstraOpenAI	4.0 min	68.6
10	Claude Sonnet 5Anthropic	3.5 min	61.2
11	Claude Sonnet 5Anthropic	3.5 min	50.7
12	GPT-5.6 TerraOpenAI	3.5 min	62.3
13	GPT-5.6 TerraOpenAI	3.5 min	58.0
14	ALing Flash 2.0Ant-group	3.5 min	45.0
15	GPT-5.6 LunaOpenAI	3.2 min	56.6
16	GPT-5.6 LunaOpenAI	3.2 min	56.5
17	DeepSeek-R1-Distill-Llama-70BDeepSeekopen	2.8 min	42.2
18	Qwen2.5 72BAlibabaopen	2.8 min	42.1
19	GPT-5.6 SolOpenAI	2.7 min	65.5
20	GPT-5.6 SolOpenAI	2.7 min	65.3
21	GPT-5.2OpenAI	2.6 min	61.5
22	GPT-5.2OpenAI	2.6 min	58.5
23	GPT-5.2OpenAI	2.6 min	57.3
24	GPT-5.2OpenAI	2.6 min	55.5
25	GPT-5.2OpenAI	2.6 min	50.2
26	Claude Fable 5.1Anthropic	2.6 min	70.3
27	Claude Opus 4.1Anthropic	2.5 min	58.1
28	Claude Opus 4.1Anthropic	2.5 min	52.6
29	GPT-5.4 miniOpenAI	2.4 min	54.8
30	GPT-5.4 miniOpenAI	2.4 min	52.9
31	GPT-5.4 miniOpenAI	2.4 min	46.0
32	ByteDance-Seed/Seed-OSS-36B-InstructNVIDIA	2.3 min	48.0
33	GPT-5.4OpenAI	2.3 min	63.4
34	GPT-5.4OpenAI	2.3 min	61.3
35	GPT-5.4OpenAI	2.3 min	58.8
36	GPT-5.4OpenAI	2.3 min	56.0
37	Qwen3.6 27BAlibabaopen	2.2 min	53.2
38	Qwen3.5-4BAlibaba	2.1 min	47.1
39	Qwen3.6 PlusAlibabaopen	2.1 min	59.0
40	GPT-5.4 nanoOpenAI	2.1 min	53.9
41	GPT-5.4 nanoOpenAI	2.1 min	48.3
42	GPT-5.4 nanoOpenAI	2.1 min	45.3
43	GPT-6 AstraOpenAI	2.1 min	69.5
44	GLM-5-TurboZhipu AI	2.0 min	58.1
45	Llama 3.2 Instruct 11B (Vision)Metaopen	2.0 min	36.4
46	Kimi K2.6Moonshot AIopen	2.0 min	60.6
47	Claude Fable 5Anthropic	1.9 min	70.4
48	Claude Fable 5Anthropic	1.9 min	65.8
49	Claude Fable 5Anthropic	1.9 min	63.9
50	Claude Opus 5Anthropic	1.8 min	70.0
51	Claude Opus 5Anthropic	1.8 min	66.8
52	GPT-5 nanoOpenAI	1.7 min	51.1
53	GPT-5 nanoOpenAI	1.7 min	45.9
54	GPT-5 nanoOpenAI	1.7 min	39.8
55	XMiMo-V2.5-ProXiaomiopen	1.7 min	59.0
56	GLM-5V-TurboZhipu AI	1.7 min	57.2
57	Kimi K3Moonshot AIopen	1.7 min	58.8
58	Kimi K3Moonshot AIopen	1.6 min	66.5
59	Kimi K3Moonshot AIopen	1.6 min	62.7
60	GLM-4.5Zhipu AIopen	1.6 min	50.2

Show 100 more