Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Machine-Learned Interatomic Potential

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Sonnet 5.5	0.9988	$28.90	111.3M	520k	17h 22m	298	7
2	Claude Opus 5.5	0.9986	$19.92	56.8M	329k	17h 53m	217	9
3	Claude Sonnet 5.5	0.9974	$29.98	117.0M	513k	18h 55m	303	2
4	Gemini 4 Argon	0.9973	$144.92	105.5M	303k	19h 54m	273	10
5	Claude Haiku 5.5	0.9960	$3.07	44.7M	342k	18h 31m	181	3
6	Claude Haiku 5.5	0.9949	$5.38	85.9M	416k	15h 26m	274	3
7	Gemini 4 Argon	0.9944	$61.24	55.2M	244k	20h 19m	189	14
8	Gemini 4 Argon	0.9938	$60.34	45.2M	281k	20h 31m	167	13
9	Gemini 4 Argon	0.9931	$56.18	57.5M	250k	20h 47m	209	10
10	Qwen3.8-Max-0902	0.9925	$42.93	126.0M	1.3M	20h 0m	617	2
11	GPT-5.6 Sol	0.9925	$108.64	109.2M	151k	11h 16m	348	8
12	GPT-5.6 Sol	0.9918	$109.29	114.5M	152k	15h 47m	404	16
13	GLM-5.3	0.9901	$21.35	50.8M	160k	19h 5m	353	1
14	Claude Haiku 5.5	0.9898	$6.24	101.6M	445k	15h 29m	304	3
15	GPT-6 Astra	0.9884	$148.01	72.8M	245k	17h 13m	283	8
16	GPT-6 Astra	0.9884	$97.13	52.7M	210k	16h 8m	257	6
17	Qwen3.8-Max-0902	0.9860	$42.29	135.8M	786k	19h 35m	535	2
18	GPT-6 Astra	0.9842	$127.33	65.0M	249k	17h 10m	287	7
19	Gemini 4 Argon	0.9823	$48.43	49.9M	216k	20h 21m	199	20
20	Claude Opus 5	0.9772	$29.82	38.2M	293k	18h 29m	172	2
21	Muse Spark 1.3	0.9755	$18.59	16.6M	98k	19h 46m	219	3
22	Qwen3.8-Max	0.9731	$4.10	11.4M	180k	17h 54m	185	3
23	GPT-6 Astra	0.9702	$43.87	26.5M	154k	17h 20m	152	9
24	GPT-6 Astra	0.9688	$90.01	51.8M	262k	15h 58m	286	7
25	Claude Fable 5	0.9674	$40.40	26.4M	189k	18h 39m	181	7
26	Muse Spark 1.3	0.9671	$61.92	58.4M	240k	19h 36m	410	4
27	Claude Opus 5.5	0.9657	$21.32	60.2M	359k	15h 52m	219	7
28	GLM-5.3 Flash	0.9637	$1.52	38.6M	196k	15h 9m	253	2
29	GLM-5.3	0.9615	$15.62	37.8M	156k	19h 29m	294	2
30	Grok 4.7	0.9608	$60.45	36.2M	244k	15h 59m	187	2
31	Grok 4.7	0.9588	$76.24	57.2M	274k	16h 2m	238	12
32	Claude Fable 5.1	0.9586	$14.22	21.7M	140k	16h 34m	179	11
33	Claude Opus 5.5	0.9563	$17.15	48.3M	286k	18h 37m	196	8
34	Grok 4.7	0.9549	$72.03	45.6M	246k	19h 9m	215	7
35	Claude Opus 5	0.9539	$25.73	31.4M	274k	19h 1m	160	10
36	Muse Spark 1.3	0.9529	$5.47	10.6M	104k	19h 34m	177	2
37	Grok 4.7	0.9454	$102.72	67.6M	289k	18h 50m	254	8
38	GPT-5.6 Sol	0.9437	$26.20	41.3M	108k	14h 19m	237	3
39	Claude Fable 5.1	0.9369	$12.11	18.4M	119k	17h 11m	175	15
40	Kimi K3	0.9282	$14.81	21.6M	194k	19h 20m	175	3
41	Qwen3.8-Max-0902	0.9269	$37.45	125.1M	855k	19h 28m	494	1
42	Qwen3.8-Max	0.9220	$5.13	15.3M	180k	19h 14m	209	2
43	Claude Opus 5.5	0.9209	$19.00	56.2M	297k	18h 34m	231	12
44	GLM-5.3	0.9184	$31.31	62.0M	243k	18h 46m	307	2
45	Kimi K3	0.9177	$11.72	20.5M	161k	18h 47m	165	3
46	DeepSeek V4 Flash Vision Exp	0.9173	$3.12	179.4M	413k	18h 25m	558	6
47	Claude Opus 5	0.9168	$37.68	49.7M	354k	18h 11m	187	8
48	Claude Haiku 5.5	0.9161	$2.25	30.2M	316k	15h 29m	134	3
49	Qwen3.8-Max-0902	0.9150	$18.33	54.0M	689k	20h 5m	323	1
50	Claude Fable 5.1	0.9113	$11.26	16.5M	124k	17h 50m	150	5
51	Claude Fable 5	0.9086	$35.59	21.8M	190k	19h 5m	148	4
52	Gemini 3.8 Flash	0.9006	$5.19	42.9M	142k	3h 20m	258	6
53	Grok 4.6	0.8964	$27.94	18.3M	258k	19h 42m	147	2
54	Kimi K3	0.8916	$6.54	9.0M	95k	18h 28m	126	2
55	Muse Spark 1.2	0.8888	$4.08	20.1M	191k	2h 11m	165	12
56	Claude Fable 5	0.8825	$22.87	13.4M	129k	19h 3m	134	6
57	Claude Fable 5.1	0.8820	$17.05	26.5M	157k	16h 32m	179	7
58	Grok 4.6	0.8799	$71.42	58.5M	227k	19h 56m	307	9
59	Muse Spark 1.2	0.8642	$31.30	153.8M	371k	2h 47m	464	12
60	Gemini 3.8 Flash	0.8493	$4.81	37.8M	168k	3h 17m	232	5
61	Gemini 3.7 Flash	0.8422	$11.45	30.2M	159k	8h 5m	208	3
62	Muse Spark 1.3	0.8349	$17.65	15.6M	188k	19h 8m	174	1
63	Grok 4.6	0.8342	$80.88	55.9M	251k	19h 37m	265	10
64	Claude Fable 5.1	0.8229	$11.99	18.2M	119k	18h 9m	171	13
65	Muse Spark 1.2	0.8223	$3.45	15.9M	178k	49m	127	3
66	GLM-5.3	0.8163	$20.32	55.4M	207k	19h 30m	350	2
67	Qwen3.8-Max	0.8093	$6.94	20.8M	251k	18h 48m	231	2
68	Kimi K3	0.8033	$15.11	21.0M	176k	19h 11m	168	3
69	Claude Fable 5	0.8027	$24.76	14.6M	137k	19h 30m	133	7
70	GLM-5.3	0.7858	$25.28	49.5M	200k	18h 31m	285	2
71	Muse Spark 1.2	0.7533	$3.65	17.8M	164k	1h 53m	126	3
72	Kimi K3	0.7378	$9.88	13.2M	119k	19h 28m	143	2
73	Gemini 3.7 Flash	0.7285	$10.95	29.5M	154k	8h 16m	213	7
74	Grok 4.6	0.7267	$28.23	20.6M	259k	19h 44m	159	3
75	Muse Spark 1.2	0.7264	$3.55	17.0M	170k	2h 17m	144	3
76	Claude Haiku 5.5	0.6983	$3.46	51.0M	368k	17h 19m	192	1
77	DeepSeek V4 Flash Vision Exp	0.6906	$1.80	93.9M	332k	18h 0m	378	6
78	Qwen3.8-Max-0902	0.6529	$37.06	123.0M	877k	19h 28m	448	2
79	Claude Opus 5	0.5927	$30.96	39.3M	312k	17h 25m	184	3
80	Grok 4.6	0.5686	$61.59	46.3M	291k	18h 29m	250	4
81	Gemini 3.7 Flash	0.5113	$8.21	27.8M	178k	5h 29m	184	2
82	DeepSeek V4 Flash Vision Exp	0.4712	$1.05	54.4M	192k	19h 29m	342	2
83	Claude Opus 5.5	0.4697	$23.43	66.1M	395k	18h 40m	232	8
84	Gemini 3.7 Flash	0.4203	$5.25	21.8M	116k	4h 45m	178	1
85	Muse Spark 1.3	0.2516	$58.45	51.9M	245k	19h 22m	357	5
86	DeepSeek V4 Flash Vision Exp	0.2438	$1.59	84.5M	269k	19h 1m	389	5
87	Qwen3.8-Max	0.2071	$6.23	16.9M	295k	18h 26m	218	2
88	Gemini 3.8 Flash	0.0997	$3.73	23.7M	117k	2h 23m	194	6
89	Claude Sonnet 5.5	0.0768	$45.32	189.2M	581k	18h 26m	414	10
90	Inkling	0.0572	$3.46	3.5M	36k	2h 37m	136	1
91	DeepSeek V4 Flash Vision Exp	0.0562	$2.23	120.5M	374k	18h 41m	436	3
92	Gemini 3.8 Flash	0.0439	$5.15	42.3M	159k	2h 44m	260	3
93	Inkling	0.0431	$4.94	5.0M	59k	45m	120	1
94	Inkling	0.0393	$6.84	7.0M	43k	1h 26m	181	1
95	Claude Fable 5	0.0239	$24.85	14.9M	135k	19h 4m	143	7
96	Claude Sonnet 5.5	0.0201	$40.13	162.7M	594k	17h 49m	356	7
97	Inkling	0.0179	$5.35	5.4M	56k	1h 32m	126	2
98	Inkling	0.0126	$4.98	5.1M	42k	1h 33m	148	2
99	GPT-5.6 Sol	0.0076	$48.99	56.5M	122k	14h 29m	293	5
100	Claude Sonnet 5.5	0.0058	$42.44	171.8M	631k	18h 38m	372	1
101	GPT-5.6 Sol	0.0010	$36.55	49.8M	109k	7h 20m	272	3
102	Qwen3.8-Max	0.0010	$4.41	12.0M	206k	19h 18m	179	1
103	Gemini 3.7 Flash	0.0010	$6.01	20.4M	174k	4h 35m	154	2
104	Gemini 3.8 Flash	0.0009	$42.37	149.3M	250k	10h 22m	415	10
105	Claude Opus 5	0.0000	$33.24	46.7M	272k	18h 15m	233	6
106	GLM-5.3 Flash	0.0000	$1.89	27.2M	201k	18h 44m	197	3
107	Grok 4.7	0.0000	$87.65	66.0M	273k	12h 6m	260	15
108	GLM-5.3 Flash	0.0000	$1.76	24.4M	187k	19h 19m	185	2
109	GLM-5.3 Flash	0.0000	$2.29	40.6M	258k	17h 24m	221	4
110	GLM-5.3 Flash	0.0000	$1.92	27.6M	178k	19h 14m	216	5