Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Quantum ESPRESSO pw.x in Rust

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Opus 5.5	0.9756	$115.01	354.9M	1.7M	9h 7m	784	13
2	Claude Sonnet 5.5	0.9756	$170.72	658.9M	3.1M	17h 11m	1438	15
3	Claude Opus 5.5	0.9756	$120.52	382.4M	1.7M	11h 39m	867	25
4	Claude Opus 5.5	0.9594	$109.78	339.6M	1.6M	7h 33m	786	12
5	Claude Opus 5.5	0.9512	$58.52	152.7M	1.1M	4h 44m	350	6
6	Claude Sonnet 5.5	0.9512	$124.72	468.1M	2.5M	11h 1m	1054	5
7	Claude Fable 5.1	0.9431	$100.68	158.8M	876k	5h 35m	408	11
8	Claude Sonnet 5.5	0.9431	$92.52	348.6M	1.8M	7h 56m	748	15
9	Claude Sonnet 5.5	0.9431	$139.31	539.0M	2.5M	15h 11m	1141	12
10	GPT-6 Astra	0.9350	$571.91	270.6M	494k	3h 53m	570	4
11	Claude Opus 5.5	0.9350	$70.36	204.4M	1.1M	5h 26m	460	11
12	Claude Fable 5.1	0.9350	$63.80	99.1M	584k	3h 4m	218	8
13	Claude Sonnet 5.5	0.9350	$154.31	585.2M	2.9M	17h 40m	1295	15
14	GPT-6 Astra	0.9350	$540.43	256.4M	446k	3h 37m	544	4
15	Claude Fable 5.1	0.9268	$63.95	99.7M	578k	3h 23m	222	5
16	Claude Fable 5.1	0.9187	$72.59	116.9M	580k	4h 7m	245	5
17	Gemini 4 Argon	0.9187	$119.37	259.0M	1.1M	10h 5m	645	1
18	Gemini 4 Argon	0.9106	$303.04	318.6M	1.2M	11h 58m	691	2
19	Claude Fable 5.1	0.9106	$77.90	124.4M	643k	3h 55m	256	4
20	Gemini 4 Argon	0.9024	$154.81	373.7M	1.6M	12h 47m	887	2
21	Gemini 4 Argon	0.9024	$388.42	369.1M	1.6M	13h 39m	867	6
22	Gemini 4 Argon	0.8699	$138.25	365.2M	1.5M	10h 38m	856	2
23	GPT-6 Astra	0.8699	$378.55	179.5M	449k	3h 11m	459	5
24	Claude Fable 5	0.8699	$390.43	293.5M	1.3M	11h 49m	656	10
25	GPT-6 Astra	0.8699	$279.05	132.3M	363k	2h 37m	372	4
26	Claude Fable 5	0.8618	$392.73	295.7M	1.3M	10h 46m	658	9
27	GPT-6 Astra	0.8293	$299.55	142.9M	339k	2h 28m	402	4
28	Claude Opus 5	0.8211	$159.35	224.3M	1.3M	7h 45m	513	7
29	Claude Fable 5	0.8211	$384.44	289.9M	1.3M	12h 52m	660	5
30	Claude Opus 5	0.8211	$245.12	359.5M	1.8M	15h 10m	826	19
31	Claude Opus 5	0.8130	$286.81	434.1M	1.9M	15h 11m	970	12
32	Claude Opus 5	0.8130	$184.58	276.3M	1.3M	15h 20m	620	7
33	Claude Fable 5	0.8049	$335.99	247.3M	1.2M	10h 59m	581	7
34	Claude Fable 5	0.7967	$346.56	252.2M	1.3M	13h 4m	602	9
35	Claude Haiku 5.5	0.7886	$28.18	430.1M	2.5M	14h 14m	967	8
36	Claude Opus 5	0.7886	$115.90	152.7M	1.1M	6h 12m	390	8
37	Claude Haiku 5.5	0.7724	$22.74	342.2M	2.1M	12h 39m	720	5
38	Claude Haiku 5.5	0.7073	$23.96	363.4M	2.1M	14h 34m	775	3
39	Claude Haiku 5.5	0.6341	$29.37	441.9M	2.7M	11h 2m	943	8
40	Grok 4.7	0.6179	$248.05	251.2M	1.1M	11h 32m	1086	16
41	Claude Haiku 5.5	0.6179	$20.61	295.8M	2.1M	11h 25m	642	7
42	GPT-5.6 Sol	0.5203	$304.21	296.3M	260k	4h 50m	606	9
43	GPT-5.6 Sol	0.4634	$57.42	64.9M	189k	2h 47m	279	13
44	Grok 4.7	0.4553	$566.99	570.1M	2.1M	20h 0m	2281	1
45	Gemini 3.8 Flash	0.4553	$73.38	570.9M	924k	15h 34m	1436	4
46	GPT-5.6 Sol	0.4553	$120.99	116.9M	214k	5h 5m	404	8
47	Gemini 3.8 Flash	0.4390	$64.68	501.7M	861k	10h 34m	1229	2
48	Muse Spark 1.3	0.4228	$418.71	442.8M	1.1M	20h 0m	1119	1
49	Muse Spark 1.3	0.4228	$514.22	583.5M	1.3M	19h 59m	1415	1
50	GPT-5.6 Sol	0.4065	$104.97	107.5M	204k	3h 16m	391	10
51	Grok 4.6	0.3984	$196.95	181.0M	1.6M	13h 51m	681	14
52	Gemini 3.8 Flash	0.3577	$44.62	399.0M	781k	9h 40m	979	7
53	Muse Spark 1.3	0.3577	$352.28	387.2M	1.4M	19h 43m	1153	3
54	Grok 4.6	0.3008	$282.67	273.1M	1.6M	13h 49m	976	40
55	Grok 4.7	0.2764	$412.96	420.2M	1.8M	14h 39m	1779	17
56	Grok 4.6	0.2683	$1211.08	1191.6M	2.2M	19h 59m	3559	243
57	Kimi K3	0.2602	$75.00	147.3M	1.2M	19h 51m	428	1
58	GLM-5.3	0.1707	$145.94	507.1M	1.3M	19h 30m	1082	13
59	Gemini 3.7 Flash	0.1545	$46.71	314.3M	747k	10h 28m	740	2
60	Muse Spark 1.3	0.1463	$336.34	348.3M	1.1M	19h 35m	939	9
61	GLM-5.3	0.1382	$132.96	476.8M	1.3M	19h 42m	984	12
62	GLM-5.3	0.1301	$108.12	382.4M	1.3M	19h 32m	838	2
63	Gemini 3.8 Flash	0.1301	$76.16	654.7M	1.0M	15h 23m	1694	6
64	Grok 4.7	0.1138	$593.38	588.6M	2.1M	20h 0m	2376	1
65	Grok 4.6	0.1057	$123.16	111.5M	1.7M	10h 28m	429	13
66	Gemini 3.8 Flash	0.1057	$39.41	364.3M	690k	7h 35m	868	4
67	Grok 4.6	0.0976	$96.14	88.3M	1.1M	7h 19m	360	12
68	Gemini 3.7 Flash	0.0976	$71.79	423.8M	777k	17h 50m	948	3
69	Grok 4.7	0.0650	$449.65	416.6M	1.1M	20h 0m	1517	11
70	Gemini 3.7 Flash	0.0650	$36.49	288.8M	712k	6h 10m	725	2
71	GLM-5.3	0.0650	$123.53	403.7M	1.6M	19h 19m	957	11
72	GLM-5.3 Flash	0.0569	$14.19	350.7M	1.3M	17h 49m	793	3
73	Kimi K3	0.0488	$160.13	415.5M	1.7M	20h 0m	999	1
74	Muse Spark 1.2	0.0244	$48.27	287.1M	1.0M	3h 0m	598	1
75	Kimi K3	0.0244	$100.42	211.3M	1.8M	20h 0m	566	1
76	Muse Spark 1.3	0.0163	$435.17	464.8M	1.2M	19h 59m	1196	1
77	Kimi K3	0.0081	$131.87	355.0M	1.3M	19h 56m	785	6
78	GLM-5.3 Flash	0.0081	$17.03	435.1M	1.2M	17h 59m	1065	16
79	Qwen3.8-Max	0.0000	$48.53	146.5M	1.8M	19h 49m	431	1
80	Qwen3.8-Max-0902	0.0000	$27.89	47.8M	2.0M	20h 3m	236	1
81	DeepSeek V4 Flash Vision Exp	0.0000	$7.62	422.1M	1.1M	12h 5m	912	6
82	Gemini 3.7 Flash	0.0000	$51.00	393.0M	804k	11h 3m	1002	4
83	Kimi K3	0.0000	$72.76	158.2M	1.2M	20h 1m	418	1
84	Muse Spark 1.2	0.0000	$22.08	58.0M	685k	1h 30m	194	3
85	Qwen3.8-Max	0.0000	$54.35	159.6M	2.3M	19h 59m	413	1
86	Qwen3.8-Max	0.0000	$33.37	86.6M	1.8M	19h 52m	301	2
87	GLM-5.3 Flash	0.0000	$10.99	299.0M	1.2M	12h 18m	713	5
88	Gemini 3.7 Flash	0.0000	$24.96	238.1M	690k	3h 15m	539	2
89	GLM-5.3 Flash	0.0000	$9.30	218.2M	1.0M	15h 25m	600	4
90	Inkling	0.0000	$18.68	19.4M	66k	28m	186	2
91	DeepSeek V4 Flash Vision Exp	0.0000	$6.14	336.4M	959k	16h 29m	853	10
92	Qwen3.8-Max-0902	0.0000	$30.52	39.7M	2.0M	20h 1m	194	1
93	Inkling	0.0000	$22.94	24.0M	46k	17m	274	1
94	DeepSeek V4 Flash Vision Exp	0.0000	$4.17	227.6M	660k	6h 35m	447	3
95	GPT-5.6 Sol	0.0000	$210.32	203.5M	250k	6h 57m	577	6
96	Inkling	0.0000	$8.19	8.5M	35k	16m	142	1
97	Muse Spark 1.2	0.0000	$8.00	39.5M	393k	1h 21m	166	2
98	Qwen3.8-Max-0902	0.0000	$26.48	47.3M	2.3M	20h 5m	231	1
99	Inkling	0.0000	$9.25	9.5M	49k	17m	146	2
100	Qwen3.8-Max-0902	0.0000	$32.89	67.0M	2.0M	20h 5m	285	1
101	DeepSeek V4 Flash Vision Exp	0.0000	$6.64	359.4M	1.1M	12h 22m	882	5
102	GLM-5.3	0.0000	$103.68	348.9M	1.2M	19h 23m	795	14
103	GLM-5.3 Flash	0.0000	$7.12	187.9M	1.1M	14h 19m	562	4
104	DeepSeek V4 Flash Vision Exp	0.0000	$6.97	389.0M	1.0M	14h 29m	887	5
105	Muse Spark 1.2	0.0000	$5.45	30.5M	131k	29m	160	3
106	Qwen3.8-Max	0.0000	$35.43	95.7M	1.8M	20h 1m	338	1
107	Inkling	0.0000	$9.32	9.6M	44k	15m	138	2
108	Muse Spark 1.2	0.0000	$10.30	54.9M	392k	1h 20m	248	4
109	Qwen3.8-Max-0902	0.0000	$26.30	38.4M	2.1M	20h 8m	222	1
110	Qwen3.8-Max	0.0000	$11.62	13.4M	1.3M	19h 53m	112	1