Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Stepper Music Sequencer GBA

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9974	$3129.48	1515.4M	2.4M	19h 55m	3376	49
2	Claude Opus 5.5	0.9917	$247.64	942.3M	2.2M	18h 17m	2063	31
3	GPT-6 Astra	0.9897	$2759.22	1308.1M	2.5M	19h 59m	2942	38
4	Claude Opus 5.5	0.9883	$203.46	765.3M	1.9M	19h 3m	1757	33
5	Claude Opus 5.5	0.9874	$283.79	1107.1M	2.3M	19h 19m	2356	8
6	Claude Opus 5.5	0.9866	$313.81	1197.7M	2.7M	18h 20m	2708	44
7	GPT-6 Astra	0.9861	$2721.06	1296.9M	2.6M	19h 56m	2978	26
8	Claude Opus 5.5	0.9844	$258.85	972.6M	2.4M	18h 43m	2211	22
9	Claude Sonnet 5.5	0.9834	$194.76	804.6M	2.6M	19h 42m	1864	5
10	GPT-6 Astra	0.9793	$2755.43	1303.4M	2.5M	19h 59m	2916	37
11	Claude Sonnet 5.5	0.9789	$233.93	974.2M	3.0M	19h 16m	2141	2
12	Claude Sonnet 5.5	0.9751	$203.75	838.4M	2.8M	19h 30m	1864	1
13	Claude Sonnet 5.5	0.9732	$218.44	904.4M	2.9M	19h 31m	2018	2
14	Claude Sonnet 5.5	0.9677	$205.23	838.3M	3.0M	19h 27m	1947	6
15	Claude Fable 5.1	0.9662	$443.40	798.0M	1.8M	18h 14m	1802	27
16	GPT-6 Astra	0.9655	$2773.42	1319.2M	2.5M	19h 57m	2941	30
17	Gemini 4 Argon	0.9654	$544.95	521.5M	2.1M	21h 0m	1162	3
18	Claude Fable 5.1	0.9569	$440.73	799.7M	1.7M	15h 10m	1825	14
19	Claude Opus 5	0.9533	$570.71	935.1M	2.7M	19h 25m	2060	23
20	Gemini 4 Argon	0.9520	$272.84	638.9M	3.5M	20h 55m	1382	4
21	Claude Fable 5.1	0.9473	$365.73	654.8M	1.6M	15h 4m	1521	20
22	Claude Fable 5.1	0.9459	$457.39	831.4M	1.7M	14h 37m	1849	32
23	Gemini 4 Argon	0.9258	$445.36	558.0M	2.3M	20h 59m	1265	1
24	Gemini 4 Argon	0.9237	$409.68	593.6M	2.6M	20h 55m	1445	7
25	Gemini 4 Argon	0.9165	$187.49	667.9M	3.3M	20h 59m	1507	2
26	Claude Haiku 5.5	0.9129	$66.38	1065.9M	4.7M	16h 56m	2384	11
27	Claude Fable 5.1	0.9053	$549.23	1015.6M	1.7M	16h 2m	2234	18
28	Claude Opus 5	0.8947	$669.61	1119.9M	2.9M	19h 5m	2462	32
29	Claude Fable 5	0.8760	$652.52	521.9M	1.8M	18h 59m	1216	15
30	Claude Opus 5	0.8643	$526.73	857.9M	2.6M	14h 11m	1791	32
31	Claude Fable 5	0.8612	$916.45	747.8M	2.3M	18h 51m	1719	16
32	Claude Opus 5	0.8500	$580.43	975.9M	2.5M	18h 59m	2103	31
33	Claude Opus 5	0.8367	$450.82	756.2M	1.9M	15h 49m	1560	11
34	GPT-5.6 Sol	0.7701	$944.54	934.7M	1.1M	15h 1m	2411	21
35	Grok 4.7	0.7472	$628.06	649.9M	2.0M	11h 13m	2618	63
36	Claude Haiku 5.5	0.7427	$60.68	993.0M	4.0M	15h 28m	2269	13
37	GPT-5.6 Sol	0.7406	$409.56	413.9M	542k	8h 34m	1251	15
38	Claude Fable 5	0.7325	$725.08	587.9M	1.9M	18h 21m	1299	12
39	GPT-5.6 Sol	0.7219	$253.31	245.2M	326k	3h 19m	679	6
40	Claude Haiku 5.5	0.7208	$38.44	612.0M	2.8M	8h 23m	1325	2
41	Claude Fable 5	0.7151	$484.68	385.7M	1.3M	18h 44m	837	11
42	Claude Haiku 5.5	0.6803	$24.48	387.9M	1.9M	5h 8m	935	6
43	Claude Haiku 5.5	0.6608	$61.93	983.3M	4.6M	18h 17m	2156	15
44	Claude Fable 5	0.6534	$728.09	583.8M	2.0M	17h 53m	1264	6
45	GLM-5.3	0.6108	$356.80	1301.6M	3.0M	19h 1m	2671	19
46	GPT-5.6 Sol	0.6048	$566.59	550.5M	752k	14h 19m	1513	11
47	Grok 4.7	0.6012	$1385.34	1395.4M	3.2M	19h 29m	5064	67
48	Grok 4.6	0.5671	$305.84	301.9M	2.2M	11h 0m	1227	45
49	Muse Spark 1.3	0.5524	$214.49	1195.2M	2.0M	12h 19m	2846	1
50	Kimi K3	0.5098	$230.68	643.2M	1.9M	20h 0m	1545	3
51	GPT-5.6 Sol	0.4981	$490.17	481.7M	531k	5h 24m	1274	32
52	Grok 4.7	0.4771	$380.66	393.3M	1.3M	7h 10m	1597	32
53	GLM-5.3	0.4715	$281.50	1008.4M	2.3M	16h 6m	2264	16
54	Grok 4.7	0.4712	$1073.48	1101.7M	3.6M	19h 4m	4513	110
55	Grok 4.7	0.4415	$440.85	450.4M	1.7M	8h 48m	1863	19
56	GLM-5.3	0.4046	$276.19	1010.3M	1.8M	15h 31m	2070	21
57	Gemini 3.8 Flash	0.4044	$62.09	665.3M	979k	9h 34m	1663	2
58	Muse Spark 1.3	0.3727	$330.62	1484.1M	2.3M	19h 59m	3305	30
59	Kimi K3	0.3706	$227.60	629.2M	1.9M	19h 47m	1504	2
60	Gemini 3.8 Flash	0.3444	$76.61	826.4M	1.1M	12h 14m	1952	4
61	GLM-5.3	0.3427	$275.26	1018.0M	1.7M	17h 39m	2090	39
62	Grok 4.6	0.3420	$868.26	872.5M	3.4M	16h 30m	3114	373
63	Kimi K3	0.3170	$227.44	622.4M	1.9M	19h 52m	1439	1
64	Muse Spark 1.3	0.3146	$507.64	559.8M	1.1M	19h 23m	1354	2
65	Gemini 3.8 Flash	0.3068	$59.22	604.8M	923k	9h 13m	1507	4
66	Gemini 3.8 Flash	0.2640	$52.50	504.3M	779k	8h 9m	1188	4
67	Grok 4.6	0.2607	$223.96	223.8M	1.5M	7h 20m	882	18
68	Grok 4.6	0.2416	$205.23	195.4M	1.9M	7h 34m	792	28
69	Gemini 3.7 Flash	0.2415	$49.29	499.9M	1.0M	4h 48m	1302	2
70	Grok 4.6	0.2197	$129.50	120.8M	2.0M	7h 52m	540	19
71	GLM-5.3 Flash	0.2060	$16.51	502.4M	1.2M	10h 2m	1235	6
72	Gemini 3.7 Flash	0.1895	$40.63	436.9M	982k	3h 1m	1134	2
73	Gemini 3.7 Flash	0.1724	$88.83	943.5M	2.1M	6h 27m	2449	1
74	Gemini 3.7 Flash	0.1698	$29.14	318.3M	646k	2h 19m	856	2
75	Gemini 3.8 Flash	0.1660	$58.00	614.2M	934k	9h 4m	1564	2
76	GLM-5.3	0.1440	$63.57	232.5M	498k	3h 14m	487	6
77	DeepSeek V4 Flash Vision Exp	0.1348	$19.48	1192.0M	1.8M	11h 51m	2670	7
78	Kimi K3	0.1336	$196.38	508.8M	1.8M	19h 51m	1209	4
79	Gemini 3.7 Flash	0.1224	$55.17	592.3M	1.3M	5h 23m	1507	5
80	DeepSeek V4 Flash Vision Exp	0.1138	$28.55	1772.4M	2.4M	15h 1m	3833	23
81	GLM-5.3 Flash	0.1080	$14.12	436.5M	1.1M	11h 4m	982	7
82	Kimi K3	0.0909	$184.74	495.2M	1.5M	19h 58m	1154	2
83	GLM-5.3 Flash	0.0899	$16.14	483.9M	1.1M	17h 24m	1112	3
84	Muse Spark 1.3	0.0797	$528.52	575.6M	1.2M	19h 59m	1313	1
85	DeepSeek V4 Flash Vision Exp	0.0534	$18.46	1143.5M	1.6M	13h 42m	2700	16
86	Muse Spark 1.3	0.0480	$556.48	567.3M	735k	19h 51m	1107	5
87	DeepSeek V4 Flash Vision Exp	0.0419	$18.93	1164.8M	1.7M	11h 44m	2764	29
88	DeepSeek V4 Flash Vision Exp	0.0319	$17.22	1033.6M	1.8M	11h 35m	2306	13
89	GLM-5.3 Flash	0.0244	$12.30	358.8M	925k	17h 17m	894	1
90	Qwen3.8-Max	0.0240	$114.04	338.0M	2.8M	19h 40m	884	6
91	Qwen3.8-Max	0.0224	$119.80	401.3M	2.9M	20h 1m	934	—
92	GLM-5.3 Flash	0.0188	$8.33	220.9M	946k	17h 57m	605	1
93	Qwen3.8-Max	0.0183	$113.87	373.6M	3.0M	19h 42m	990	—
94	Muse Spark 1.2	0.0175	$37.47	155.3M	1.3M	5h 29m	460	7
95	Qwen3.8-Max	0.0159	$129.76	393.1M	2.8M	19h 53m	1102	—
96	Qwen3.8-Max	0.0002	$139.67	464.7M	2.7M	19h 56m	1203	—
97	Qwen3.8-Max-0902	0.0000	$43.55	102.3M	1.5M	20h 4m	428	1
98	Qwen3.8-Max-0902	0.0000	$38.27	81.2M	1.4M	20h 9m	421	1
99	Qwen3.8-Max-0902	0.0000	$38.10	91.8M	1.7M	20h 3m	413	1
100	Qwen3.8-Max-0902	0.0000	$31.88	60.8M	1.6M	20h 2m	390	1
101	Inkling	0.0000	$3.82	3.9M	21k	15m	103	2
102	Qwen3.8-Max-0902	0.0000	$41.37	105.1M	1.6M	20h 8m	436	1
103	Inkling	0.0000	$6.62	6.9M	28k	22m	168	1
104	Inkling	0.0000	$8.48	8.8M	35k	24m	171	2
105	Muse Spark 1.2	0.0000	$44.79	140.1M	936k	4h 21m	543	4
106	Inkling	0.0000	$10.64	11.1M	32k	19m	193	1
107	Muse Spark 1.2	0.0000†	$4.68	18.3M	123k	58m	156	2
108	Muse Spark 1.2	0.0000†	$53.19	95.9M	776k	4h 50m	351	2
109	Inkling	0.0000	$5.72	5.9M	31k	22m	140	2
110	Muse Spark 1.2	0.0000†	$10.59	43.3M	223k	2h 38m	259	3

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.