Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Wan 2.1 on MAX/Mojo

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Opus 5.5	0.9802	$29.40	86.6M	447k	5h 37m	213	11
2	Claude Opus 5.5	0.9629	$25.12	76.6M	348k	3h 15m	207	9
3	GPT-6 Astra	0.9623	$128.98	66.9M	202k	2h 32m	252	3
4	Claude Opus 5.5	0.9582	$32.70	105.1M	419k	5h 38m	261	4
5	Claude Sonnet 5.5	0.9507	$48.17	184.2M	875k	10h 49m	465	8
6	Claude Opus 5.5	0.9506	$43.10	137.3M	584k	6h 47m	287	8
7	Claude Fable 5	0.9491	$104.43	77.8M	325k	9h 34m	228	9
8	Claude Haiku 5.5	0.9458	$12.55	176.8M	1.3M	10h 31m	417	2
9	Claude Opus 5.5	0.9418	$33.25	107.7M	418k	4h 32m	251	4
10	Claude Sonnet 5.5	0.9377	$25.94	98.3M	468k	4h 54m	246	4
11	Claude Haiku 5.5	0.9373	$12.10	180.8M	1.1M	11h 0m	434	2
12	Claude Sonnet 5.5	0.9359	$40.87	157.9M	720k	8h 10m	372	6
13	Claude Sonnet 5.5	0.9357	$44.27	175.5M	715k	8h 40m	410	1
14	Claude Opus 5	0.9354	$108.05	175.6M	512k	12h 46m	386	16
15	Muse Spark 1.3	0.9348	$88.24	91.7M	303k	11h 17m	409	2
16	Claude Fable 5.1	0.9331	$62.26	106.8M	367k	8h 14m	284	8
17	Claude Fable 5	0.9315	$97.01	70.7M	318k	7h 13m	197	8
18	Claude Fable 5.1	0.9314	$52.87	90.3M	319k	5h 49m	274	9
19	Claude Opus 5	0.9312	$80.95	128.6M	410k	11h 23m	326	7
20	Kimi K3	0.9307	$34.42	90.2M	306k	9h 26m	306	5
21	Claude Fable 5	0.9285	$88.74	65.2M	284k	7h 6m	208	10
22	Claude Opus 5	0.9268	$66.75	102.7M	380k	7h 37m	277	3
23	Claude Fable 5	0.9266	$114.36	85.0M	368k	10h 16m	234	6
24	GPT-5.6 Sol	0.9241	$103.11	107.4M	168k	5h 28m	369	8
25	Grok 4.7	0.9226	$177.41	173.6M	635k	11h 45m	724	2
26	GPT-6 Astra	0.9217	$103.16	56.8M	189k	2h 7m	236	3
27	Claude Haiku 5.5	0.9211	$6.92	102.7M	574k	5h 59m	240	2
28	Claude Fable 5.1	0.9205	$68.80	118.8M	390k	9h 16m	323	6
29	Claude Sonnet 5.5	0.9205	$42.18	157.9M	816k	8h 38m	414	4
30	Kimi K3	0.9196	$29.20	75.3M	345k	8h 0m	286	8
31	Claude Fable 5.1	0.9192	$42.87	72.2M	281k	5h 13m	226	5
32	Claude Fable 5.1	0.9186	$55.53	95.2M	329k	8h 32m	279	10
33	Gemini 4 Argon	0.9182	$55.03	65.4M	246k	4h 0m	171	2
34	Claude Opus 5	0.9178	$120.16	201.7M	487k	16h 10m	440	12
35	GPT-6 Astra	0.9173	$183.34	92.0M	226k	1h 45m	305	2
36	Claude Fable 5	0.9155	$108.63	80.2M	355k	9h 49m	237	8
37	GPT-6 Astra	0.9153	$76.89	42.2M	156k	1h 3m	187	3
38	GLM-5.3	0.9144	$51.16	175.7M	465k	14h 14m	461	2
39	GPT-6 Astra	0.9128	$82.94	47.1M	162k	1h 37m	205	3
40	GLM-5.3 Flash	0.9128	$8.72	173.1M	406k	16h 39m	489	2
41	Claude Haiku 5.5	0.9123	$8.89	128.7M	893k	9h 43m	376	2
42	Gemini 4 Argon	0.9115	$102.53	78.3M	305k	5h 26m	181	2
43	Claude Haiku 5.5	0.9110	$9.22	144.9M	750k	8h 8m	333	6
44	GLM-5.3	0.9094	$42.10	140.4M	401k	16h 39m	404	2
45	Grok 4.7	0.9093	$209.09	202.2M	818k	13h 1m	844	2
46	Kimi K3	0.9090	$15.06	37.9M	188k	7h 2m	204	7
47	GLM-5.3 Flash	0.9090	$7.68	170.3M	428k	17h 42m	476	6
48	GLM-5.3	0.9087	$43.47	155.3M	374k	16h 47m	478	2
49	GPT-5.6 Sol	0.9087	$34.04	44.6M	108k	4h 5m	199	9
50	Grok 4.6	0.9085	$149.23	138.7M	1.3M	12h 2m	586	2
51	Claude Opus 5	0.9082	$82.70	130.5M	438k	8h 38m	327	9
52	Gemini 4 Argon	0.9073	$129.59	105.1M	283k	6h 53m	216	2
53	Gemini 4 Argon	0.9069	$23.60	61.0M	217k	3h 19m	175	2
54	GPT-5.6 Sol	0.9062	$69.52	78.1M	124k	3h 50m	295	3
55	Grok 4.7	0.9053	$77.01	77.8M	250k	3h 37m	315	1
56	Grok 4.6	0.9047	$29.23	30.9M	270k	3h 12m	158	1
57	Qwen3.8-Max-0902	0.9041	$56.78	149.1M	2.5M	19h 20m	497	2
58	GPT-5.6 Sol	0.9014	$57.11	66.4M	129k	4h 8m	267	5
59	Grok 4.6	0.9010	$76.51	66.4M	639k	9h 42m	273	2
60	Muse Spark 1.3	0.9005	$242.82	232.9M	452k	19h 26m	628	1
61	Qwen3.8-Max-0902	0.8953	$47.14	117.0M	1.9M	19h 7m	442	3
62	GLM-5.3 Flash	0.8916	$10.09	169.1M	376k	15h 54m	473	4
63	Kimi K3	0.8899	$31.51	84.6M	291k	12h 22m	348	3
64	GPT-5.6 Sol	0.8681	$66.06	72.8M	105k	4h 8m	267	4
65	Muse Spark 1.3	0.4425	$115.32	111.6M	449k	19h 59m	385	1
66	Muse Spark 1.3	0.4417	$126.25	155.2M	591k	19h 59m	465	1
67	Qwen3.8-Max	0.4407	$34.51	98.7M	1.3M	19h 41m	423	2
68	Qwen3.8-Max	0.4404	$41.19	95.2M	1.6M	20h 1m	427	1
69	DeepSeek V4 Flash Vision Exp	0.4396	$4.92	297.3M	464k	19h 11m	681	11
70	Muse Spark 1.3	0.4389	$215.78	199.3M	678k	15h 8m	502	24
71	DeepSeek V4 Flash Vision Exp	0.4384	$3.53	204.1M	419k	17h 55m	562	3
72	DeepSeek V4 Flash Vision Exp	0.3550	$2.99	168.7M	386k	19h 32m	453	3
73	Gemini 3.8 Flash	0.3530	$39.56	333.6M	688k	9h 57m	942	3
74	Qwen3.8-Max-0902	0.3268	$45.66	130.9M	1.8M	19h 28m	461	3
75	Qwen3.8-Max-0902	0.3247	$58.55	156.5M	2.2M	19h 45m	512	3
76	Gemini 3.8 Flash	0.3004	$49.60	408.7M	919k	17h 49m	1099	1
77	Gemini 3.8 Flash	0.2989	$50.71	448.6M	743k	11h 49m	1104	1
78	Qwen3.8-Max	0.2981	$45.25	145.8M	997k	19h 53m	526	1
79	GLM-5.3 Flash	0.2971	$8.91	144.0M	373k	19h 10m	444	3
80	Kimi K3	0.2838	$85.29	208.6M	954k	19h 56m	558	3
81	DeepSeek V4 Flash Vision Exp	0.2720	$3.61	208.7M	436k	14h 28m	562	11
82	Grok 4.6	0.2716	$127.41	108.5M	1.7M	19h 30m	464	4
83	DeepSeek V4 Flash Vision Exp	0.2506	$3.27	186.8M	413k	17h 5m	493	5
84	Grok 4.6	0.2296	$214.90	198.0M	1.7M	19h 41m	759	13
85	Gemini 4 Argon	0.1758	$81.73	98.5M	410k	6h 12m	259	1
86	GLM-5.3	0.0945	$60.08	134.7M	351k	20h 1m	432	1
87	Qwen3.8-Max	0.0664	$30.34	85.4M	1.2M	19h 11m	360	2
88	Qwen3.8-Max-0902	0.0446	$62.40	166.9M	2.3M	19h 54m	538	1
89	Inkling	0.0429	$17.12	17.9M	30k	2h 11m	192	1
90	Inkling	0.0404	$13.85	14.5M	23k	1h 11m	142	1
91	Gemini 3.7 Flash	0.0349	$23.63	178.6M	776k	6h 26m	569	1
92	Gemini 3.7 Flash	0.0347	$27.48	166.6M	453k	6h 47m	438	1
93	Gemini 3.7 Flash	0.0331	$42.63	248.9M	797k	11h 49m	716	1
94	Muse Spark 1.2	0.0325	$10.93	49.7M	405k	2h 44m	182	3
95	Gemini 3.8 Flash	0.0317	$65.98	570.2M	1.4M	17h 58m	1492	1
96	Gemini 3.7 Flash	0.0317	$28.92	149.4M	462k	8h 34m	380	1
97	Gemini 3.7 Flash	0.0310	$36.97	183.1M	560k	8h 49m	483	1
98	Gemini 3.8 Flash	0.0309	$52.78	424.0M	773k	11h 32m	1103	2
99	Inkling	0.0305	$12.93	13.5M	35k	14m	141	1
100	Muse Spark 1.2	0.0252	$38.37	181.5M	771k	3h 21m	481	13
101	GLM-5.3	0.0239	$77.39	173.5M	511k	19h 46m	464	11
102	Qwen3.8-Max	0.0000	$50.91	123.3M	1.9M	19h 56m	467	1
103	Muse Spark 1.2	0.0000	$29.55	111.8M	325k	3h 53m	331	2
104	Muse Spark 1.2	0.0000†	$16.08	77.6M	385k	3h 9m	254	2
105	Inkling	0.0000	$16.05	16.8M	29k	1h 23m	176	2
106	Grok 4.7	0.0000	$218.86	185.5M	568k	19h 57m	791	8
107	Grok 4.7	0.0000	$85.96	87.7M	287k	4h 37m	388	1
108	Muse Spark 1.2	0.0000	$10.80	49.7M	240k	3h 10m	226	3
109	Inkling	0.0000	$11.47	11.9M	30k	1h 18m	145	2
110	GLM-5.3 Flash	0.0000	$11.04	225.6M	397k	17h 7m	578	3

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.