Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Dart Style in Haskell

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Opus 5.5	0.9894	$168.41	622.4M	1.6M	10h 59m	1389	39
2	Claude Opus 5.5	0.9885	$192.52	720.9M	1.8M	13h 2m	1670	53
3	Claude Opus 5.5	0.9853	$159.11	577.5M	1.6M	9h 35m	1338	18
4	Claude Opus 5.5	0.9829	$190.35	691.9M	2.0M	9h 34m	1602	24
5	Claude Opus 5.5	0.9733	$318.71	1272.8M	2.4M	16h 51m	2868	99
6	Claude Sonnet 5.5	0.9726	$294.32	1267.9M	3.1M	19h 20m	2767	15
7	Gemini 4 Argon	0.9654	$218.42	430.1M	2.0M	15h 3m	1010	21
8	Claude Sonnet 5.5	0.9628	$264.23	1140.1M	2.8M	19h 20m	2386	18
9	GPT-6 Astra	0.9601	$2439.09	1157.2M	2.2M	16h 56m	2671	30
10	Claude Sonnet 5.5	0.9599	$231.53	982.7M	2.7M	19h 6m	2099	8
11	Claude Sonnet 5.5	0.9594	$281.27	1200.2M	3.2M	19h 38m	2675	25
12	Gemini 4 Argon	0.9568	$288.60	454.6M	2.0M	16h 22m	1093	14
13	Gemini 4 Argon	0.9534	$274.81	581.3M	2.0M	17h 49m	1368	15
14	Gemini 4 Argon	0.9529	$147.73	628.9M	2.2M	16h 46m	1478	23
15	GPT-6 Astra	0.9508	$2034.34	972.8M	1.7M	15h 13m	2216	42
16	Claude Fable 5.1	0.9491	$569.86	1069.9M	1.4M	17h 10m	2285	28
17	Claude Sonnet 5.5	0.9484	$282.69	1214.1M	3.1M	19h 50m	2712	18
18	GPT-6 Astra	0.9472	$895.41	422.2M	827k	6h 22m	958	14
19	Gemini 4 Argon	0.9457	$337.69	476.2M	2.1M	17h 14m	1055	18
20	GPT-6 Astra	0.9426	$2766.39	1322.7M	2.4M	19h 53m	2984	74
21	Claude Fable 5.1	0.9284	$552.06	1031.1M	1.5M	18h 56m	2091	46
22	Claude Fable 5.1	0.9275	$456.14	848.4M	1.3M	18h 57m	2026	39
23	Claude Opus 5	0.8972	$636.78	1144.6M	1.6M	19h 47m	2383	4
24	GPT-6 Astra	0.8965	$171.46	81.1M	258k	2h 1m	277	7
25	Claude Fable 5.1	0.8919	$415.43	774.8M	1.2M	19h 19m	1796	47
26	Claude Fable 5	0.8720	$1092.68	955.8M	1.8M	19h 38m	2037	16
27	Claude Fable 5.1	0.8712	$313.43	577.0M	1.0M	18h 15m	1283	12
28	Claude Opus 5	0.8643	$420.46	752.1M	1.2M	19h 22m	1536	5
29	Claude Fable 5	0.8484	$882.98	764.1M	1.5M	19h 42m	1840	23
30	Claude Opus 5	0.8376	$279.11	485.1M	948k	19h 29m	1196	3
31	Claude Haiku 5.5	0.8374	$77.49	1375.8M	3.3M	18h 52m	2942	36
32	Claude Fable 5	0.8275	$664.26	571.5M	1.2M	19h 26m	1197	10
33	Claude Opus 5	0.8261	$296.13	517.9M	961k	18h 59m	1277	26
34	Claude Opus 5	0.8114	$315.87	552.3M	1.0M	19h 44m	1262	18
35	Claude Fable 5	0.8095	$644.11	555.7M	1.2M	19h 31m	1237	15
36	Claude Haiku 5.5	0.8018	$62.96	1119.5M	2.6M	19h 39m	2502	41
37	Claude Haiku 5.5	0.7992	$77.73	1399.9M	2.9M	18h 46m	2994	20
38	GPT-5.6 Sol	0.7949	$998.14	972.7M	983k	19h 18m	2146	16
39	Claude Fable 5	0.7696	$331.51	264.9M	908k	19h 45m	637	2
40	Grok 4.7	0.7672	$810.72	832.8M	2.4M	19h 51m	3315	144
41	Claude Haiku 5.5	0.7663	$58.71	1042.8M	2.4M	19h 8m	2192	17
42	Claude Haiku 5.5	0.7528	$39.53	699.1M	1.7M	19h 36m	1507	18
43	Grok 4.7	0.7101	$934.33	959.7M	2.7M	20h 0m	3786	76
44	Grok 4.7	0.6935	$819.81	827.3M	2.4M	19h 30m	3292	79
45	Grok 4.7	0.6906	$879.91	896.0M	2.8M	19h 59m	3561	82
46	GPT-5.6 Sol	0.6779	$433.00	423.6M	391k	6h 1m	844	4
47	Gemini 3.8 Flash	0.6582	$120.09	1254.6M	1.6M	19h 48m	2946	161
48	Gemini 3.7 Flash	0.6517	$199.28	2123.1M	2.6M	19h 55m	4917	62
49	GPT-5.6 Sol	0.6344	$89.80	91.5M	201k	1h 55m	362	5
50	Muse Spark 1.2	0.6241	$2.29	11.0M	77k	1h 6m	128	3
51	Gemini 3.8 Flash	0.6130	$135.28	1312.0M	1.7M	19h 37m	2953	110
52	GPT-5.6 Sol	0.6068	$48.47	52.9M	204k	1h 35m	274	3
53	Grok 4.6	0.5864	$513.86	512.7M	2.7M	20h 0m	2054	59
54	Kimi K3	0.5650	$209.81	607.6M	1.3M	20h 1m	1454	19
55	Muse Spark 1.3	0.5513	$525.73	756.2M	1.1M	19h 57m	1637	8
56	Kimi K3	0.5395	$190.44	541.2M	1.2M	19h 50m	1336	3
57	Gemini 3.7 Flash	0.5376	$121.24	1110.9M	1.5M	19h 27m	2524	37
58	GLM-5.3	0.5299	$165.74	599.8M	1.1M	19h 6m	1398	51
59	Muse Spark 1.3	0.5258	$522.21	631.2M	1.1M	19h 59m	1757	5
60	Muse Spark 1.3	0.5020	$463.61	501.9M	1.1M	19h 20m	1265	9
61	Gemini 3.8 Flash	0.4900	$51.76	544.5M	634k	8h 8m	1241	24
62	Kimi K3	0.4874	$196.59	547.1M	1.3M	19h 46m	1241	8
63	Qwen3.8-Max	0.4828	$83.97	303.2M	1.2M	16h 38m	893	2
64	GLM-5.3	0.4696	$158.77	595.9M	645k	19h 33m	1177	12
65	GLM-5.3	0.4653	$144.84	516.1M	611k	19h 39m	1066	22
66	GLM-5.3	0.4595	$150.71	560.0M	706k	19h 32m	1263	35
67	GPT-5.6 Sol	0.4547	$71.79	84.5M	237k	2h 25m	406	7
68	Gemini 3.7 Flash	0.4365	$75.56	629.3M	934k	19h 55m	1331	3
69	Grok 4.7	0.4324	$263.14	264.6M	900k	6h 3m	996	20
70	Kimi K3	0.4305	$123.27	338.1M	738k	19h 52m	670	1
71	Gemini 3.7 Flash	0.4242	$33.92	324.0M	891k	3h 25m	780	8
72	GLM-5.3 Flash	0.4031	$18.46	598.3M	640k	20h 1m	1200	1
73	DeepSeek V4 Flash Vision Exp	0.4014	$18.12	1122.6M	1.6M	19h 51m	2602	23
74	GLM-5.3 Flash	0.4009	$22.72	722.1M	1.2M	19h 26m	1667	27
75	GLM-5.3	0.3788	$98.82	359.7M	600k	20h 0m	738	1
76	Muse Spark 1.3	0.3680	$506.26	577.2M	925k	19h 53m	1567	1
77	GLM-5.3 Flash	0.3666	$15.53	455.8M	658k	20h 1m	864	1
78	Qwen3.8-Max	0.3212	$156.83	579.3M	1.7M	20h 1m	1506	1
79	Gemini 3.7 Flash	0.3137	$25.24	282.5M	578k	1h 28m	590	2
80	Grok 4.6	0.3015	$389.00	386.7M	2.2M	19h 53m	1645	42
81	Qwen3.8-Max-0902	0.2762	$68.64	209.5M	2.5M	19h 58m	650	1
82	Qwen3.8-Max	0.2726	$83.47	304.6M	1.0M	17h 28m	843	2
83	Qwen3.8-Max	0.2674	$50.86	177.6M	941k	18h 25m	662	12
84	DeepSeek V4 Flash Vision Exp	0.2342	$7.03	436.2M	602k	8h 13m	914	3
85	DeepSeek V4 Flash Vision Exp	0.2234	$21.23	1304.8M	2.0M	15h 38m	2836	7
86	GLM-5.3 Flash	0.2155	$15.10	395.1M	560k	20h 1m	851	1
87	Qwen3.8-Max-0902	0.1979	$53.96	142.4M	2.8M	19h 56m	444	1
88	Grok 4.6	0.1785	$547.31	552.2M	2.4M	19h 52m	2177	74
89	Gemini 3.8 Flash	0.1718	$3.02	22.3M	97k	43m	198	3
90	DeepSeek V4 Flash Vision Exp	0.1638	$15.31	956.5M	1.3M	19h 4m	2023	3
91	GLM-5.3 Flash	0.1396	$17.07	519.3M	626k	20h 0m	1015	1
92	Gemini 3.8 Flash	0.1167	$2.13	14.3M	77k	33m	176	2
93	Muse Spark 1.2	0.1043	$2.53	9.5M	123k	1h 21m	101	1
94	Muse Spark 1.2	0.1040	$2.18	10.0M	104k	1h 4m	113	2
95	Muse Spark 1.2	0.1040	$3.41	16.0M	109k	59m	110	2
96	Qwen3.8-Max	0.0853	$104.77	373.0M	1.7M	19h 28m	957	1
97	DeepSeek V4 Flash Vision Exp	0.0766	$15.69	953.5M	1.5M	16h 48m	2199	5
98	Qwen3.8-Max-0902	0.0514	$56.12	143.5M	3.2M	20h 2m	493	1
99	Muse Spark 1.2	0.0377	$5.55	30.5M	146k	1h 16m	174	2
100	Muse Spark 1.3	0.0010	$582.91	707.6M	1.1M	19h 56m	1740	10
101	Inkling	0.0000	$2.95	3.1M	10k	11m	87	2
102	Inkling	0.0000	$20.49	21.4M	45k	32m	241	1
103	Qwen3.8-Max-0902	0.0000	$93.37	320.2M	1.9M	20h 1m	755	2
104	Grok 4.6	0.0000	$485.05	493.3M	2.2M	19h 52m	1992	109
105	Qwen3.8-Max-0902	0.0000	$44.97	92.5M	2.9M	20h 1m	511	1
106	Grok 4.6	0.0000	$402.09	394.7M	2.1M	17h 23m	1524	78
107	Inkling	0.0000	$19.88	20.7M	49k	1h 2m	297	1
108	Inkling	0.0000	$7.80	8.1M	20k	1h 3m	140	1
109	Inkling	0.0000	$4.62	4.8M	11k	1h 10m	101	2
110	Kimi K3	0.0000	$86.57	238.4M	589k	20h 1m	593	1