Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Git to Zig

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9864	$3111.97	1407.9M	3.4M	19h 58m	3119	48
2	GPT-6 Astra	0.9049	$3006.21	1380.7M	3.3M	20h 0m	3129	60
3	GPT-6 Astra	0.8950	$2950.79	1350.4M	3.3M	19h 50m	3031	52
4	GPT-6 Astra	0.8938	$3057.89	1408.3M	3.3M	19h 59m	3204	96
5	GPT-6 Astra	0.8893	$3214.36	1493.6M	3.2M	19h 59m	3347	99
6	Claude Opus 5.5	0.6812	$313.47	1048.3M	4.0M	19h 32m	2436	25
7	Claude Opus 5.5	0.6644	$241.59	773.6M	3.3M	19h 40m	1843	33
8	Claude Opus 5.5	0.6378	$222.91	717.3M	3.1M	19h 51m	1607	19
9	Claude Opus 5.5	0.6246	$242.07	814.4M	3.0M	19h 50m	1773	32
10	Claude Sonnet 5.5	0.6193	$286.71	1152.7M	4.4M	19h 47m	2662	17
11	Claude Sonnet 5.5	0.6146	$288.13	1151.1M	4.5M	19h 38m	2487	13
12	Claude Sonnet 5.5	0.6064	$328.10	1331.6M	4.8M	19h 55m	3071	8
13	Claude Opus 5.5	0.5824	$188.65	606.3M	2.6M	19h 43m	1437	34
14	Claude Fable 5.1	0.5599	$663.30	1199.7M	2.6M	18h 57m	2674	17
15	Claude Sonnet 5.5	0.5548	$219.87	857.0M	3.8M	19h 46m	2030	10
16	Gemini 4 Argon	0.5447	$362.36	783.2M	2.2M	20h 48m	1753	26
17	Claude Sonnet 5.5	0.5357	$185.56	725.4M	3.2M	19h 53m	1763	8
18	Gemini 4 Argon	0.5225	$190.93	727.6M	2.5M	20h 51m	1657	23
19	Claude Fable 5.1	0.5146	$566.08	1019.0M	2.3M	19h 11m	2360	13
20	Claude Fable 5.1	0.5049	$432.88	762.8M	2.1M	18h 58m	1732	13
21	Claude Fable 5.1	0.4886	$363.29	631.2M	2.0M	18h 58m	1562	11
22	Claude Fable 5.1	0.4844	$390.64	686.7M	2.0M	19h 13m	1611	26
23	Gemini 4 Argon	0.4697	$330.68	663.7M	1.9M	20h 55m	1569	11
24	Gemini 4 Argon	0.4294	$398.78	647.4M	2.0M	20h 52m	1487	26
25	Gemini 4 Argon	0.4167	$333.71	642.4M	2.0M	20h 59m	1402	31
26	Claude Fable 5	0.4059	$841.49	687.0M	2.0M	19h 35m	1534	22
27	Claude Fable 5	0.4009	$1051.04	892.5M	2.1M	19h 47m	1943	25
28	Claude Opus 5	0.3856	$635.16	1128.1M	1.8M	19h 53m	2411	22
29	Claude Fable 5	0.3814	$1038.32	878.7M	2.1M	19h 45m	1942	22
30	Claude Opus 5	0.3683	$533.23	935.7M	1.7M	19h 23m	1826	15
31	Claude Fable 5	0.3565	$966.19	820.9M	1.9M	19h 53m	1710	14
32	GPT-5.6 Sol	0.3440	$1238.08	1225.0M	944k	19h 8m	2627	21
33	Claude Opus 5	0.3411	$614.97	1098.7M	1.7M	19h 37m	2206	22
34	Claude Fable 5	0.3411	$903.80	768.8M	1.8M	19h 40m	1672	10
35	Claude Haiku 5.5	0.3210	$69.20	1225.1M	2.9M	18h 51m	2564	3
36	Claude Haiku 5.5	0.3209	$63.68	1097.5M	3.2M	19h 26m	2348	44
37	Claude Opus 5	0.3150	$429.99	753.2M	1.4M	19h 44m	1660	18
38	Claude Opus 5	0.3034	$490.76	870.1M	1.4M	19h 44m	1974	13
39	Claude Haiku 5.5	0.2918	$66.19	1196.6M	2.4M	17h 47m	2539	17
40	Claude Haiku 5.5	0.2897	$71.59	1281.2M	2.8M	19h 16m	2753	24
41	Claude Haiku 5.5	0.2814	$60.90	1077.6M	2.7M	19h 17m	2251	20
42	GPT-5.6 Sol	0.2804	$1082.72	1080.1M	850k	19h 36m	2314	42
43	GPT-5.6 Sol	0.2801	$1175.97	1171.4M	884k	19h 37m	2602	29
44	Grok 4.7	0.2530	$1242.68	1266.7M	4.0M	20h 0m	5068	70
45	Grok 4.7	0.2469	$910.55	936.9M	2.7M	19h 58m	3768	53
46	GPT-5.6 Sol	0.2369	$955.56	945.7M	722k	19h 4m	1982	13
47	Grok 4.7	0.2342	$1107.04	1144.5M	3.0M	20h 0m	4638	66
48	Grok 4.7	0.2156	$741.65	767.0M	2.0M	19h 54m	3099	73
49	Gemini 3.8 Flash	0.1938	$193.40	2143.9M	2.9M	19h 15m	4751	23
50	Grok 4.7	0.1876	$623.38	637.1M	2.0M	13h 32m	2600	18
51	GPT-5.6 Sol	0.1874	$770.31	763.5M	629k	19h 0m	1668	6
52	Gemini 3.7 Flash	0.1808	$157.01	1517.8M	2.4M	19h 43m	3256	1
53	Gemini 3.8 Flash	0.1795	$179.04	1977.0M	2.7M	19h 44m	4293	17
54	Kimi K3	0.1768	$251.00	752.4M	1.2M	20h 2m	1619	1
55	Kimi K3	0.1733	$200.20	602.7M	965k	19h 43m	1483	13
56	Gemini 3.8 Flash	0.1706	$167.16	1718.1M	2.3M	19h 49m	3932	19
57	Grok 4.6	0.1693	$652.70	657.8M	2.2M	19h 59m	2502	122
58	Gemini 3.8 Flash	0.1621	$197.44	2159.7M	2.7M	19h 47m	4872	28
59	Grok 4.6	0.1618	$614.44	610.4M	2.6M	18h 0m	2324	73
60	Kimi K3	0.1616	$254.18	761.8M	1.1M	19h 47m	1668	9
61	Gemini 3.8 Flash	0.1604	$196.69	2138.2M	2.7M	20h 0m	4694	26
62	Kimi K3	0.1574	$259.84	779.9M	1.1M	19h 53m	1765	2
63	GLM-5.3	0.1556	$225.36	842.0M	964k	19h 45m	2012	17
64	GLM-5.3	0.1531	$195.54	692.6M	689k	19h 54m	1480	2
65	Grok 4.6	0.1516	$806.68	819.7M	2.2M	19h 59m	2981	186
66	Inkling	0.1510	$17.77	18.6M	32k	1h 29m	255	1
67	Gemini 3.7 Flash	0.1495	$79.59	838.0M	1.2M	20h 0m	1855	2
68	Kimi K3	0.1473	$222.64	660.4M	1.1M	19h 44m	1491	1
69	Gemini 3.7 Flash	0.1433	$101.57	1069.8M	1.5M	19h 58m	2372	1
70	GLM-5.3 Flash	0.1431	$24.60	751.1M	974k	19h 4m	1752	13
71	Muse Spark 1.3	0.1427	$402.31	656.1M	1.1M	18h 56m	1632	3
72	GLM-5.3	0.1390	$212.77	708.2M	852k	19h 49m	1640	49
73	GLM-5.3	0.1378	$248.79	932.5M	906k	19h 55m	2219	21
74	Grok 4.6	0.1352	$482.88	483.0M	1.6M	11h 22m	1767	84
75	GLM-5.3 Flash	0.1328	$26.79	827.0M	1.1M	19h 10m	1751	10
76	GLM-5.3 Flash	0.1304	$29.71	954.5M	1.0M	19h 55m	2035	10
77	DeepSeek V4 Flash Vision Exp	0.1304	$28.18	1759.3M	2.2M	19h 24m	3723	15
78	Muse Spark 1.3	0.1274	$518.45	593.9M	920k	19h 54m	1465	2
79	Grok 4.6	0.1269	$408.61	405.7M	1.8M	19h 55m	1558	48
80	GLM-5.3 Flash	0.1260	$27.25	852.3M	924k	19h 18m	1873	6
81	Gemini 3.7 Flash	0.1237	$71.55	746.3M	1.3M	19h 57m	1690	4
82	GLM-5.3	0.1219	$188.86	712.0M	621k	19h 43m	1318	16
83	DeepSeek V4 Flash Vision Exp	0.1213	$28.06	1756.1M	2.2M	19h 43m	3793	11
84	Qwen3.8-Max	0.1212	$184.24	696.5M	1.3M	19h 33m	1805	12
85	GLM-5.3 Flash	0.1195	$28.09	863.8M	1.0M	19h 28m	2000	13
86	DeepSeek V4 Flash Vision Exp	0.1193	$26.16	1630.6M	2.1M	19h 37m	3584	8
87	Qwen3.8-Max-0902	0.1143	$142.85	503.3M	2.3M	19h 27m	1335	8
88	DeepSeek V4 Flash Vision Exp	0.1079	$21.83	1364.0M	1.7M	17h 17m	2977	8
89	Muse Spark 1.3	0.1062	$484.87	561.8M	975k	20h 0m	1499	1
90	Qwen3.8-Max	0.1038	$196.74	742.9M	1.4M	19h 38m	1831	26
91	Qwen3.8-Max	0.1023	$180.44	685.7M	1.2M	19h 14m	1776	2
92	Muse Spark 1.3	0.1006	$482.98	557.2M	1.0M	20h 0m	1594	15
93	DeepSeek V4 Flash Vision Exp	0.0988	$20.50	1272.8M	1.7M	19h 17m	2732	11
94	Qwen3.8-Max	0.0987	$178.20	662.0M	1.7M	19h 50m	1710	6
95	Qwen3.8-Max	0.0927	$190.64	725.2M	1.3M	19h 52m	1620	35
96	Qwen3.8-Max-0902	0.0891	$199.99	712.3M	3.1M	19h 47m	1665	9
97	Qwen3.8-Max-0902	0.0536	$90.79	292.3M	2.5M	20h 1m	788	2
98	Qwen3.8-Max-0902	0.0529	$127.39	412.8M	3.6M	20h 1m	1158	1
99	Muse Spark 1.2	0.0185	$42.33	250.7M	911k	3h 1m	578	5
100	Inkling	0.0093	$17.52	18.3M	28k	1h 29m	208	3
101	Qwen3.8-Max-0902	0.0086	$101.78	346.1M	2.1M	20h 0m	916	2
102	Inkling	0.0019	$16.36	17.1M	30k	17m	280	1
103	Muse Spark 1.2	0.0000†	$2.45	9.3M	123k	59m	86	2
104	Inkling	0.0000	$3.15	3.3M	13k	5m	86	2
105	Muse Spark 1.3	0.0000	$641.52	782.0M	1.4M	19h 59m	1580	1
106	Muse Spark 1.2	0.0000†	$5.53	26.0M	135k	1h 56m	175	4
107	Muse Spark 1.2	0.0000†	$59.99	358.3M	658k	4h 22m	779	1
108	Gemini 3.7 Flash	0.0000†	$76.41	819.6M	1.5M	19h 43m	1734	1
109	Inkling	0.0000†	$5.57	5.8M	17k	1h 55m	118	2
110	Muse Spark 1.2	0.0000†	$2.14	7.7M	83k	1h 10m	93	3

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.