Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

FFmpeg libswscale Optimization

task page →50 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.8080	$283.04	487.0M	1.6M	13h 9m	1070	46
2	Claude Fable 5.1	0.5509	$202.06	343.4M	1.3M	9h 13m	819	28
3	Claude Fable 5.1	0.5106	$148.93	254.0M	906k	6h 11m	641	18
4	GLM-5.3	0.1752	$226.40	818.4M	2.0M	19h 33m	1884	18
5	GLM-5.3	0.1410	$148.35	524.2M	1.7M	16h 26m	1303	8
6	GLM-5.3	0.1369	$139.76	505.8M	1.2M	11h 14m	1097	9
7	Claude Fable 5.1	0.1368	$219.11	385.2M	1.1M	10h 27m	835	22
8	Kimi K3	0.1260	$127.79	342.6M	1.2M	13h 59m	827	13
9	Kimi K3	0.1252	$211.22	606.6M	1.4M	19h 43m	1382	3
10	GLM-5.3	0.1231	$175.55	619.5M	1.7M	16h 47m	1509	8
11	Kimi K3	0.0799	$127.97	356.2M	1.1M	15h 4m	914	11
12	GLM-5.3	0.0783	$177.95	625.3M	1.7M	17h 1m	1420	8
13	DeepSeek V4 Flash Vision Exp	0.0668	$8.52	493.3M	1.0M	6h 44m	1095	8
14	Kimi K3	0.0639	$138.03	382.3M	1.1M	17h 32m	902	2
15	DeepSeek V4 Flash Vision Exp	0.0636	$9.11	528.7M	1.1M	6h 10m	1172	5
16	DeepSeek V4 Flash Vision Exp	0.0602	$13.77	800.3M	1.6M	9h 14m	1831	19
17	DeepSeek V4 Flash Vision Exp	0.0483	$9.39	554.1M	1.0M	5h 54m	1197	16
18	Qwen3.8-Max	0.0373	$86.44	286.2M	2.3M	17h 43m	706	6
19	Grok 4.6	0.0360	$419.25	404.2M	2.4M	19h 56m	1517	114
20	Qwen3.8-Max	0.0181	$64.05	193.9M	2.4M	18h 48m	555	1
21	Gemini 3.7 Flash	0.0125	$20.83	184.0M	617k	2h 35m	524	2
22	Qwen3.8-Max	0.0053	$46.03	124.6M	2.3M	19h 58m	424	1
23	Gemini 3.7 Flash	0.0032	$19.94	167.8M	795k	2h 4m	496	7
24	Grok 4.6	0.0000	$1121.42	1126.0M	2.4M	18h 11m	3693	434
25	Muse Spark 1.2	0.0000	$15.42	90.0M	327k	41m	286	2
26	Grok 4.6	0.0000	$68.40	59.6M	603k	3h 50m	229	4
27	Muse Spark 1.2	0.0000	$16.97	85.6M	384k	1h 38m	227	4
28	Claude Fable 5.1	0.0000	$217.24	363.8M	1.5M	10h 22m	893	27
29	Qwen3.8-Max	0.0000	$54.69	158.2M	2.4M	18h 58m	475	1
30	Grok 4.6	0.0000	$132.56	129.2M	778k	5h 28m	562	27
31	Inkling	0.0000	$11.24	11.7M	27k	1h 20m	165	2
32	Inkling	0.0000	$15.45	16.1M	35k	22m	188	2
33	Qwen3.8-Max	0.0000	$30.12	66.3M	2.1M	19h 55m	298	1
34	Inkling	0.0000	$39.66	41.4M	77k	41m	354	2
35	Gemini 3.7 Flash	0.0000	$25.27	228.2M	1.1M	2h 14m	655	5
36	GPT-5.6	0.0000	$66.82	75.1M	179k	1h 59m	318	8
37	Inkling	0.0000	$15.51	16.2M	36k	32m	190	1
38	Muse Spark 1.2	0.0000	$11.90	64.7M	340k	1h 14m	223	2
39	GPT-5.6	0.0000	$78.43	84.8M	190k	2h 4m	348	5
40	Grok 4.6	0.0000	$380.75	368.6M	1.8M	11h 52m	1370	67
41	Muse Spark 1.2	0.0000	$35.70	203.8M	978k	3h 29m	468	8
42	GPT-5.6	0.0000	$123.31	124.9M	233k	2h 12m	422	3
43	Kimi K3	0.0000	$171.14	500.1M	1.1M	19h 41m	1175	47
44	GPT-5.6	0.0000	$76.67	86.4M	186k	3h 5m	369	10
45	DeepSeek V4 Flash Vision Exp	0.0000	$12.34	718.0M	1.4M	8h 32m	1678	16
46	GPT-5.6	0.0000	$117.96	120.8M	233k	3h 42m	405	8
47	Inkling	0.0000	$11.17	11.6M	27k	16m	167	1
48	Gemini 3.7 Flash	0.0000	$16.99	131.7M	937k	2h 45m	448	6
49	Muse Spark 1.2	0.0000	$27.98	159.1M	568k	1h 40m	345	2
50	Gemini 3.7 Flash	0.0000	$44.74	251.9M	922k	8h 1m	758	6