Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

MEG Speech Decoding

task page →43 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.3166	$19.44	30.2M	179k	16h 28m	214	8
2	Claude Fable 5.1	0.3123	$26.35	42.8M	204k	16h 51m	240	12
3	GPT-5.6	0.3119	$41.21	43.5M	133k	5h 23m	204	2
4	Claude Fable 5.1	0.3116	$13.99	21.5M	133k	17h 11m	192	11
5	Claude Fable 5.1	0.3057	$16.57	26.2M	144k	13h 23m	202	11
6	Grok 4.6	0.3041	$128.46	122.4M	984k	15h 5m	545	23
7	GPT-5.6	0.3039	$14.10	19.5M	85k	2h 25m	137	2
8	GPT-5.6	0.2311	$153.75	128.1M	180k	10h 45m	298	17
9	Grok 4.6	0.2265	$217.69	204.9M	1.2M	19h 25m	878	23
10	GLM-5.3	0.2244	$22.68	51.0M	188k	18h 6m	315	2
11	Claude Fable 5.1	0.2155	$25.98	41.7M	212k	14h 56m	237	10
12	Grok 4.6	0.2107	$132.86	129.3M	708k	19h 25m	571	33
13	GLM-5.3	0.2036	$34.96	74.2M	244k	14h 55m	372	2
14	GPT-5.6	0.1902	$64.35	67.7M	163k	7h 2m	279	4
15	GPT-5.6	0.1862	$104.80	98.3M	165k	7h 53m	318	8
16	Grok 4.6	0.1844	$95.16	83.3M	284k	18h 58m	362	11
17	DeepSeek V4 Flash Vision Exp	0.1749	$1.32	68.7M	240k	18h 36m	359	6
18	Muse Spark 1.2	0.1659	$17.10	36.3M	144k	3h 7m	130	6
19	GLM-5.3	0.1492	$27.34	90.5M	318k	15h 42m	371	3
20	Qwen3.8-Max	0.1460	$13.18	43.8M	302k	19h 37m	333	7
21	Grok 4.6	0.1245	$71.38	67.2M	365k	9h 53m	293	10
22	Muse Spark 1.2	0.1175	$9.52	47.7M	272k	3h 44m	183	8
23	Gemini 3.7 Flash	0.1130	$4.87	33.1M	132k	3h 51m	226	1
24	Gemini 3.7 Flash	0.1121	$12.12	51.3M	122k	7h 24m	312	4
25	Kimi K3	0.1102	$14.90	32.2M	173k	18h 22m	254	3
26	GLM-5.3	0.1032	$33.80	77.7M	262k	19h 7m	353	2
27	Muse Spark 1.2	0.1011	$11.96	61.9M	415k	4h 37m	241	3
28	Qwen3.8-Max	0.0985	$20.47	70.2M	412k	18h 53m	478	2
29	Gemini 3.7 Flash	0.0948	$9.93	38.7M	111k	7h 46m	266	5
30	Gemini 3.7 Flash	0.0854	$10.11	35.8M	110k	7h 53m	303	1
31	DeepSeek V4 Flash Vision Exp	0.0826	$1.73	93.5M	273k	12h 25m	457	2
32	GLM-5.3	0.0000	$49.90	134.3M	340k	19h 4m	469	21
33	Qwen3.8-Max	0.0000	$13.84	45.7M	331k	19h 21m	336	2
34	Inkling	0.0000	$5.29	5.5M	26k	1h 28m	151	1
35	Qwen3.8-Max	0.0000	$27.96	99.7M	412k	19h 32m	527	4
36	Muse Spark 1.2	0.0000	$13.11	77.0M	195k	5h 0m	202	3
37	Inkling	0.0000	$5.01	5.2M	28k	1h 29m	128	1
38	Gemini 3.7 Flash	0.0000	$12.20	48.7M	173k	7h 50m	285	2
39	Muse Spark 1.2	0.0000	$16.36	73.7M	275k	2h 42m	244	7
40	Inkling	0.0000	$6.23	6.3M	53k	2h 6m	139	1
41	Qwen3.8-Max	0.0000	$8.55	26.2M	281k	19h 56m	242	1
42	Inkling	0.0000	$5.31	5.5M	23k	2h 3m	134	2
43	Inkling	0.0000	$5.42	5.6M	24k	1h 30m	116	1