Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Fitness-Recap Video in Remotion

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.7901	$2673.96	1271.2M	2.5M	19h 58m	2991	31
2	GPT-6 Astra	0.7705	$2639.52	1259.7M	2.5M	19h 50m	2961	27
3	GPT-6 Astra	0.7148	$2733.41	1304.4M	2.5M	19h 53m	2977	29
4	GPT-6 Astra	0.6873	$2846.47	1353.6M	2.5M	19h 54m	3114	36
5	GPT-6 Astra	0.6437	$2584.51	1240.4M	2.4M	19h 47m	2920	23
6	Claude Sonnet 5.5	0.3659	$232.86	951.4M	2.7M	19h 46m	2188	3
7	Claude Opus 5.5	0.3605	$270.94	1051.2M	2.1M	19h 10m	2403	12
8	Claude Fable 5	0.3226	$587.70	496.9M	1.2M	18h 28m	1118	8
9	Claude Sonnet 5.5	0.3212	$193.06	791.5M	2.2M	19h 6m	1718	1
10	Claude Sonnet 5.5	0.3201	$185.52	762.3M	2.2M	19h 19m	1724	2
11	Claude Sonnet 5.5	0.3192	$216.22	909.3M	2.5M	19h 44m	2030	2
12	Claude Opus 5.5	0.2926	$307.93	1148.9M	1.9M	19h 20m	2553	28
13	Claude Opus 5.5	0.2905	$179.59	686.0M	1.3M	19h 22m	1645	21
14	Claude Sonnet 5.5	0.2754	$168.83	706.6M	2.1M	19h 28m	1679	3
15	Claude Opus 5.5	0.2637	$181.24	683.8M	1.4M	19h 15m	1667	19
16	Gemini 4 Argon	0.2451	$233.36	596.2M	1.7M	16h 49m	1260	12
17	Claude Opus 5.5	0.2443	$84.28	312.7M	521k	9h 32m	660	10
18	Gemini 4 Argon	0.2401	$112.07	365.5M	1.1M	10h 13m	860	5
19	Claude Haiku 5.5	0.2316	$28.48	497.9M	1.3M	13h 17m	1085	8
20	Claude Opus 5	0.2280	$444.54	757.9M	1.7M	18h 35m	1644	23
21	Claude Opus 5	0.2251	$524.60	906.1M	1.9M	19h 37m	1949	17
22	Gemini 4 Argon	0.2185	$165.03	335.8M	998k	11h 8m	805	2
23	Claude Haiku 5.5	0.2169	$33.38	569.6M	1.7M	9h 44m	1300	6
24	Claude Fable 5	0.2168	$885.34	754.4M	1.7M	18h 17m	1721	16
25	Claude Opus 5	0.2158	$509.67	881.7M	1.8M	18h 48m	1852	8
26	Claude Opus 5	0.2155	$438.52	750.5M	1.6M	18h 17m	1648	14
27	GPT-5.6 Sol	0.2152	$950.51	938.4M	1.0M	19h 3m	2343	45
28	Claude Opus 5	0.2129	$501.05	832.6M	1.6M	18h 19m	1912	14
29	Gemini 4 Argon	0.2055	$210.50	290.4M	915k	10h 7m	717	2
30	Claude Fable 5.1	0.2055	$157.69	293.5M	491k	6h 51m	665	8
31	Claude Fable 5	0.2027	$655.49	552.4M	1.4M	18h 20m	1203	14
32	Claude Fable 5.1	0.2018	$157.38	293.1M	476k	6h 7m	644	7
33	Gemini 4 Argon	0.1980	$159.82	263.8M	756k	8h 13m	636	3
34	Claude Haiku 5.5	0.1957	$25.71	439.2M	1.3M	6h 34m	947	5
35	GPT-5.6 Sol	0.1930	$656.93	636.3M	650k	19h 12m	1478	11
36	Claude Fable 5.1	0.1927	$120.12	223.7M	414k	5h 14m	587	7
37	GPT-5.6 Sol	0.1913	$298.28	288.7M	261k	7h 23m	651	12
38	GPT-5.6 Sol	0.1895	$283.99	275.5M	274k	5h 43m	687	6
39	GLM-5.3	0.1894	$78.50	212.7M	442k	18h 20m	530	6
40	Claude Haiku 5.5	0.1842	$16.30	276.2M	923k	15h 8m	666	11
41	GLM-5.3	0.1828	$113.14	407.8M	483k	19h 2m	804	9
42	Muse Spark 1.3	0.1827	$179.29	1045.0M	1.1M	19h 56m	2290	8
43	Kimi K3	0.1767	$191.75	571.0M	982k	19h 53m	1356	3
44	GLM-5.3 Flash	0.1750	$19.23	554.0M	928k	19h 35m	1394	1
45	Claude Fable 5.1	0.1730	$560.60	1048.2M	1.5M	18h 2m	2274	26
46	Kimi K3	0.1723	$171.83	504.1M	1.1M	19h 44m	1234	8
47	Kimi K3	0.1716	$266.42	802.2M	1.3M	20h 1m	1618	1
48	Claude Haiku 5.5	0.1704	$8.47	145.8M	443k	15h 41m	419	9
49	GLM-5.3 Flash	0.1702	$12.92	416.9M	481k	11h 49m	1002	5
50	DeepSeek V4 Flash Vision Exp	0.1621	$10.73	658.6M	994k	19h 13m	1651	18
51	Qwen3.8-Max-0902	0.1486	$33.48	89.8M	1.0M	20h 8m	410	2
52	Qwen3.8-Max	0.1474	$77.77	271.1M	994k	13h 7m	800	4
53	Claude Fable 5	0.1467	$662.31	571.3M	1.2M	19h 23m	1221	12
54	Qwen3.8-Max-0902	0.1462	$31.95	68.8M	1.2M	20h 2m	351	1
55	GLM-5.3	0.1426	$118.44	380.0M	784k	18h 55m	986	18
56	GPT-5.6 Sol	0.1374	$190.12	189.9M	230k	5h 21m	589	2
57	Muse Spark 1.3	0.1338	$375.85	806.9M	1.0M	20h 0m	1927	3
58	Claude Fable 5	0.1112	$587.97	497.7M	1.2M	19h 20m	1094	10
59	GLM-5.3	0.1053	$110.52	388.9M	908k	15h 36m	961	9
60	GLM-5.3 Flash	0.1000	$22.01	692.4M	913k	17h 25m	1635	6
61	Grok 4.7	0.0961	$439.29	445.6M	1.3M	9h 16m	1738	103
62	GLM-5.3 Flash	0.0914	$16.05	372.4M	537k	19h 9m	828	3
63	Grok 4.7	0.0840	$675.93	699.4M	1.7M	12h 52m	2790	89
64	GLM-5.3	0.0837	$90.93	307.2M	485k	16h 10m	636	8
65	DeepSeek V4 Flash Vision Exp	0.0738	$6.53	405.2M	565k	19h 26m	994	10
66	Qwen3.8-Max	0.0733	$163.48	458.4M	1.7M	19h 54m	1249	1
67	Claude Fable 5.1	0.0694	$335.29	627.1M	960k	15h 45m	1456	19
68	Kimi K3	0.0657	$243.01	727.7M	1.1M	20h 1m	1633	1
69	Kimi K3	0.0536	$202.63	587.9M	1.0M	19h 57m	1479	12
70	Grok 4.7	0.0491	$750.66	786.8M	2.0M	15h 22m	3238	130
71	DeepSeek V4 Flash Vision Exp	0.0483	$6.64	411.0M	525k	16h 0m	983	21
72	Grok 4.7	0.0481	$814.19	833.8M	1.7M	19h 58m	3225	109
73	Grok 4.7	0.0422	$931.62	946.8M	1.9M	20h 0m	3560	153
74	GLM-5.3 Flash	0.0395	$21.46	680.4M	950k	19h 31m	1613	12
75	Muse Spark 1.3	0.0362	$213.98	610.8M	874k	19h 50m	1636	3
76	Grok 4.6	0.0338	$1762.94	1204.0M	2.8M	20h 0m	4175	289
77	DeepSeek V4 Flash Vision Exp	0.0324	$12.46	767.8M	1.1M	18h 4m	1789	24
78	Qwen3.8-Max-0902	0.0314	$43.03	134.8M	748k	20h 9m	405	1
79	Grok 4.6	0.0279	$646.10	557.5M	1.5M	19h 48m	2043	149
80	Muse Spark 1.3	0.0269	$429.57	453.8M	790k	19h 52m	1245	2
81	Muse Spark 1.3	0.0263	$363.14	496.5M	863k	19h 59m	1337	1
82	Grok 4.6	0.0245	$555.19	490.3M	1.5M	19h 56m	2020	90
83	Grok 4.6	0.0242	$1149.83	792.5M	1.8M	19h 58m	2836	250
84	Gemini 3.8 Flash	0.0241	$38.64	291.2M	430k	9h 43m	866	3
85	Grok 4.6	0.0216	$746.94	531.5M	1.4M	19h 55m	1941	163
86	Gemini 3.7 Flash	0.0129	$13.97	114.7M	211k	4h 23m	382	2
87	Qwen3.8-Max	0.0127	$196.38	482.4M	1.8M	19h 51m	1048	1
88	DeepSeek V4 Flash Vision Exp	0.0121	$4.01	242.4M	395k	12h 19m	777	16
89	Gemini 3.7 Flash	0.0091	$2.94	21.2M	86k	1h 20m	169	2
90	Gemini 3.7 Flash	0.0089	$10.44	67.7M	164k	2h 48m	328	4
91	Gemini 3.7 Flash	0.0080	$7.68	61.7M	148k	2h 7m	300	1
92	Muse Spark 1.2	0.0079	$12.46	62.2M	180k	3h 28m	270	3
93	Qwen3.8-Max	0.0062	$52.83	157.6M	675k	9h 28m	578	4
94	Muse Spark 1.2	0.0060	$91.70	184.1M	1.3M	8h 42m	509	3
95	Gemini 3.7 Flash	0.0060	$4.67	30.1M	112k	2h 7m	222	1
96	Qwen3.8-Max-0902	0.0051	$35.22	96.8M	1.1M	20h 1m	342	1
97	Muse Spark 1.2	0.0032	$14.71	29.2M	224k	3h 30m	183	2
98	Muse Spark 1.2	0.0031	$37.85	75.3M	303k	4h 52m	285	4
99	Qwen3.8-Max-0902	0.0029	$28.31	69.9M	1.1M	20h 5m	355	1
100	Inkling	0.0006	$14.05	14.6M	38k	1h 0m	183	1
101	Inkling	0.0001	$7.96	8.3M	26k	31m	141	2
102	Gemini 3.8 Flash	0.0000†	$3.21	19.3M	43k	1h 20m	160	1
103	Gemini 3.8 Flash	0.0000†	$3.95	27.7M	51k	1h 46m	183	1
104	Inkling	0.0000	$13.72	14.2M	49k	59m	205	1
105	Inkling	0.0000	$10.65	11.1M	29k	1h 18m	172	2
106	Inkling	0.0000	$11.15	11.6M	44k	40m	138	1
107	Qwen3.8-Max	0.0000†	$11.91	31.2M	238k	4h 2m	292	2
108	Muse Spark 1.2	0.0000†	$12.66	38.1M	209k	4h 41m	190	1
109	Gemini 3.8 Flash	0.0000†	$1.73	10.5M	40k	42m	105	1
110	Gemini 3.8 Flash	0.0000†	$4.92	31.8M	62k	1h 28m	213	1

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.