Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Crash-Proof Flash Filesystem

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Sonnet 5.5	0.9994	$65.32	251.2M	1.2M	7h 54m	507	9
2	Claude Sonnet 5.5	0.9991	$90.59	355.9M	1.5M	17h 4m	824	6
3	Claude Sonnet 5.5	0.9988	$62.92	245.6M	1.1M	10h 2m	522	11
4	Claude Fable 5	0.9988	$187.27	145.7M	561k	6h 17m	294	8
5	Claude Sonnet 5.5	0.9981	$69.13	270.2M	1.2M	18h 11m	576	4
6	Claude Opus 5.5	0.9981	$27.48	78.1M	449k	2h 59m	213	5
7	Claude Opus 5.5	0.9981	$26.95	76.7M	440k	2h 11m	202	7
8	Claude Sonnet 5.5	0.9978	$42.06	150.5M	930k	4h 45m	371	2
9	Claude Opus 5.5	0.9978	$40.02	124.8M	561k	3h 28m	245	7
10	Claude Opus 5.5	0.9978	$56.18	167.0M	853k	5h 25m	375	8
11	Claude Opus 5.5	0.9978	$31.57	92.4M	498k	2h 55m	217	4
12	Claude Opus 5	0.9977	$235.26	378.0M	1.2M	15h 3m	814	17
13	Claude Fable 5	0.9975	$300.62	253.7M	627k	16h 21m	456	10
14	Claude Fable 5.1	0.9970	$49.34	77.1M	443k	2h 57m	208	6
15	Claude Fable 5.1	0.9927	$43.72	70.9M	340k	3h 17m	229	4
16	Claude Fable 5.1	0.9927	$61.85	100.4M	479k	3h 5m	243	10
17	Claude Fable 5	0.9894	$286.95	239.2M	640k	18h 38m	417	7
18	Claude Fable 5	0.9784	$330.54	261.4M	927k	18h 19m	649	14
19	Claude Fable 5	0.8904	$290.91	231.9M	787k	18h 31m	576	9
20	Claude Fable 5.1	0.8898	$81.53	137.5M	526k	5h 0m	326	10
21	Claude Opus 5	0.8852	$226.31	360.9M	1.2M	15h 56m	756	18
22	Claude Opus 5	0.8705	$196.81	310.4M	1.1M	15h 31m	680	10
23	Claude Opus 5	0.8628	$231.46	372.7M	1.2M	17h 30m	794	16
24	Gemini 4 Argon	0.7378	$152.44	168.7M	1.1M	7h 34m	429	3
25	Claude Opus 5	0.6631	$126.31	185.3M	890k	10h 20m	498	10
26	GPT-6 Astra	0.6090	$92.20	45.6M	190k	1h 44m	177	4
27	GPT-6 Astra	0.5968	$497.70	237.1M	397k	4h 16m	516	14
28	GPT-6 Astra	0.5902	$154.84	75.5M	253k	1h 42m	259	5
29	GPT-6 Astra	0.5835	$114.98	55.8M	198k	1h 55m	208	5
30	GPT-6 Astra	0.5519	$228.77	111.2M	286k	2h 11m	332	5
31	Gemini 4 Argon	0.5467	$54.25	127.4M	708k	4h 23m	300	2
32	Gemini 4 Argon	0.2570	$245.29	429.7M	1.7M	13h 47m	960	3
33	Claude Haiku 5.5	0.1981	$23.67	373.5M	1.8M	4h 55m	822	2
34	Gemini 4 Argon	0.1980	$156.36	254.9M	1.4M	8h 56m	624	2
35	Gemini 4 Argon	0.1446	$77.78	221.0M	1.0M	7h 15m	532	2
36	Grok 4.7	0.0806	$696.28	696.9M	2.0M	12h 34m	2584	17
37	Claude Haiku 5.5	0.0687	$47.91	775.4M	3.3M	12h 44m	1650	6
38	Grok 4.6	0.0610	$858.44	859.7M	2.4M	19h 46m	2990	501
39	Claude Haiku 5.5	0.0528	$36.17	586.2M	2.5M	9h 44m	1238	4
40	Kimi K3	0.0431	$197.20	550.4M	1.5M	20h 1m	1197	1
41	Gemini 3.8 Flash	0.0394	$80.97	751.6M	1.2M	15h 46m	1693	10
42	Claude Haiku 5.5	0.0255	$45.61	737.3M	3.2M	16h 38m	1572	8
43	Grok 4.6	0.0241	$445.27	424.9M	2.8M	19h 59m	1572	200
44	Gemini 3.8 Flash	0.0229	$99.02	916.4M	1.5M	20h 0m	2136	2
45	GPT-5.6 Sol	0.0225	$66.23	68.5M	180k	1h 47m	274	8
46	GPT-5.6 Sol	0.0225	$81.19	79.4M	199k	1h 55m	291	7
47	GPT-5.6 Sol	0.0224	$73.40	72.5M	171k	1h 41m	273	8
48	Gemini 3.7 Flash	0.0217	$93.80	813.5M	2.3M	19h 56m	2141	1
49	Gemini 3.8 Flash	0.0186	$116.31	1099.4M	1.7M	19h 58m	2658	1
50	Gemini 3.8 Flash	0.0186	$181.15	1820.6M	3.3M	20h 0m	4383	2
51	Grok 4.7	0.0184	$312.58	313.6M	1.2M	9h 0m	1280	10
52	Grok 4.7	0.0184	$793.49	801.3M	2.8M	20h 0m	3084	23
53	Muse Spark 1.3	0.0177	$523.70	619.4M	1.1M	20h 0m	1409	1
54	Claude Fable 5.1	0.0173	$56.44	90.9M	453k	4h 18m	228	8
55	Grok 4.7	0.0173	$406.03	410.3M	1.5M	9h 50m	1624	19
56	GPT-5.6 Sol	0.0173	$159.04	153.2M	259k	4h 31m	440	16
57	GPT-5.6 Sol	0.0173	$92.72	87.0M	212k	1h 59m	268	7
58	GLM-5.3	0.0173	$171.41	627.5M	1.2M	19h 32m	1385	14
59	Muse Spark 1.3	0.0173	$532.50	628.8M	1.0M	20h 0m	1552	1
60	GLM-5.3	0.0173	$236.98	874.4M	1.4M	19h 51m	1908	31
61	Claude Haiku 5.5	0.0173	$35.40	562.3M	2.6M	7h 29m	1185	5
62	Grok 4.7	0.0164	$349.50	343.9M	1.4M	11h 51m	1349	8
63	Grok 4.6	0.0117	$262.00	255.9M	1.7M	13h 11m	1039	20
64	Kimi K3	0.0112	$202.76	569.3M	1.5M	19h 50m	1237	2
65	Gemini 3.7 Flash	0.0112	$89.95	756.9M	1.7M	20h 0m	1907	1
66	GLM-5.3	0.0111	$148.21	526.6M	1.0M	18h 49m	1175	16
67	DeepSeek V4 Flash Vision Exp	0.0110	$29.12	1761.2M	2.9M	19h 19m	3911	24
68	Qwen3.8-Max-0902	0.0057	$36.03	58.6M	3.4M	19h 58m	271	1
69	DeepSeek V4 Flash Vision Exp	0.0053	$22.61	1343.5M	2.5M	19h 20m	2867	26
70	GLM-5.3	0.0049	$108.31	386.0M	1.3M	16h 54m	851	5
71	DeepSeek V4 Flash Vision Exp	0.0049	$20.65	1205.0M	2.5M	19h 56m	2498	19
72	GLM-5.3 Flash	0.0049	$18.82	518.9M	1.2M	16h 54m	1227	7
73	Muse Spark 1.2	0.0049	$36.55	207.9M	989k	3h 16m	456	11
74	Kimi K3	0.0049	$158.40	411.0M	1.7M	20h 0m	1010	1
75	GLM-5.3 Flash	0.0049	$17.24	495.9M	945k	18h 11m	1222	7
76	DeepSeek V4 Flash Vision Exp	0.0049	$17.94	1097.8M	1.6M	18h 58m	2348	14
77	Gemini 3.7 Flash	0.0049	$62.15	472.1M	1.5M	20h 0m	1139	1
78	DeepSeek V4 Flash Vision Exp	0.0049	$20.78	1251.0M	2.1M	19h 4m	2804	15
79	Kimi K3	0.0049	$190.49	508.0M	1.5M	19h 54m	1111	9
80	GLM-5.3 Flash	0.0049	$25.92	740.1M	1.3M	17h 17m	1469	14
81	GLM-5.3 Flash	0.0047	$19.42	522.2M	1.2M	17h 11m	1230	5
82	Muse Spark 1.2	0.0047	$53.94	336.5M	554k	4h 31m	660	7
83	Grok 4.6	0.0046	$267.41	252.9M	1.7M	10h 33m	927	132
84	GLM-5.3	0.0039	$154.89	566.6M	1.0M	19h 45m	1350	18
85	Muse Spark 1.2	0.0038	$13.60	58.8M	346k	1h 50m	189	3
86	Muse Spark 1.2	0.0033	$35.75	222.8M	379k	2h 39m	489	7
87	Grok 4.6	0.0031	$181.59	175.3M	1.4M	8h 20m	693	24
88	Gemini 3.7 Flash	0.0024	$124.70	1220.5M	2.9M	20h 0m	2795	1
89	Qwen3.8-Max	0.0013	$12.18	16.0M	1.3M	19h 33m	130	1
90	Gemini 3.8 Flash	0.0013	$151.24	1551.3M	2.4M	20h 0m	3613	1
91	Gemini 3.7 Flash	0.0010	$64.73	520.0M	1.4M	20h 0m	1356	1
92	Qwen3.8-Max-0902	0.0008	$39.79	67.5M	3.7M	19h 56m	275	6
93	Qwen3.8-Max-0902	0.0008	$36.61	60.3M	3.5M	20h 1m	294	2
94	Kimi K3	0.0008	$195.88	529.5M	1.7M	20h 0m	1266	2
95	GLM-5.3 Flash	0.0008	$18.99	548.2M	1.2M	18h 12m	1172	11
96	Qwen3.8-Max-0902	0.0008	$33.78	44.2M	3.7M	20h 1m	226	1
97	Qwen3.8-Max-0902	0.0006	$33.01	43.7M	3.6M	20h 1m	236	1
98	Muse Spark 1.3	0.0002	$572.11	638.9M	1.2M	19h 59m	1384	1
99	Qwen3.8-Max	0.0001	$13.81	19.3M	1.5M	19h 35m	164	3
100	Qwen3.8-Max	0.0000	$14.39	19.8M	1.5M	20h 1m	160	1
101	Inkling	0.0000	$14.16	14.7M	37k	1h 30m	184	2
102	Muse Spark 1.3	0.0000	$486.57	544.5M	845k	19h 59m	1421	1
103	Qwen3.8-Max	0.0000	$9.18	10.7M	1.0M	19h 50m	100	1
104	Inkling	0.0000	$9.30	9.7M	22k	11m	123	2
105	Muse Spark 1.3	0.0000	$536.44	601.3M	1.3M	19h 59m	1324	1
106	Inkling	0.0000	$12.08	12.6M	23k	14m	161	2
107	Qwen3.8-Max	0.0000	$13.72	18.7M	1.5M	18h 42m	146	3
108	Muse Spark 1.2	0.0000	$18.50	97.7M	207k	1h 10m	269	4
109	Inkling	0.0000	$16.45	17.2M	21k	16m	173	2
110	Inkling	0.0000	$13.17	13.7M	28k	1h 27m	186	2