Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lua Native Compiler

task page →50 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	1.0000	$44.19	69.8M	381k	3h 24m	215	8
2	Claude Fable 5.1	1.0000	$51.03	82.5M	402k	3h 56m	245	12
3	Claude Fable 5.1	1.0000	$55.84	88.8M	470k	3h 14m	235	6
4	GLM-5.3	0.9976	$201.34	735.2M	1.4M	11h 37m	1660	3
5	GLM-5.3	0.9953	$142.13	511.6M	1.2M	9h 22m	1178	2
6	DeepSeek V4 Flash Vision Exp	0.9788	$23.06	1383.4M	2.4M	13h 19m	2911	21
7	GLM-5.3	0.9599	$274.76	1000.1M	1.8M	19h 32m	2273	5
8	Kimi K3	0.9575	$183.51	524.3M	1.3M	19h 59m	1203	20
9	GLM-5.3	0.9527	$236.30	883.7M	1.1M	17h 20m	1835	7
10	Kimi K3	0.8750	$185.22	530.7M	1.3M	20h 0m	1207	1
11	Claude Fable 5.1	0.8463	$43.78	69.0M	381k	3h 39m	231	1
12	Gemini 3.7 Flash	0.6998	$21.69	183.4M	580k	2h 58m	400	1
13	Claude Fable 5.1	0.6667	$57.38	92.1M	466k	4h 40m	248	7
14	Gemini 3.7 Flash	0.6541	$62.39	519.3M	1.2M	7h 8m	1260	1
15	Gemini 3.7 Flash	0.6517	$26.08	255.3M	824k	1h 58m	670	1
16	Gemini 3.7 Flash	0.6392	$29.13	278.2M	822k	3h 5m	751	1
17	Grok 4.6	0.6384	$176.45	167.1M	1.5M	7h 26m	653	8
18	Kimi K3	0.5063	$220.93	645.6M	1.2M	20h 2m	1461	1
19	Gemini 3.7 Flash	0.3270	$79.34	743.6M	1.7M	8h 42m	1815	1
20	Kimi K3	0.2862	$159.88	431.8M	1.4M	19h 11m	1009	1
21	DeepSeek V4 Flash Vision Exp	0.2005	$21.27	1250.2M	2.4M	15h 16m	2676	17
22	Inkling	0.0000	$27.74	28.9M	72k	42m	300	1
23	Inkling	0.0000	$16.92	17.5M	67k	44m	221	1
24	Qwen3.8-Max	0.0000	$64.51	206.8M	2.0M	19h 8m	639	2
25	DeepSeek V4 Flash Vision Exp	0.0000	$11.39	676.4M	1.3M	7h 45m	1507	15
26	Grok 4.6	0.0000	$110.36	107.0M	986k	5h 11m	447	8
27	Inkling	0.0000	$48.62	50.6M	132k	1h 1m	367	2
28	GPT-5.6	0.0000	$35.07	44.0M	172k	2h 41m	211	10
29	Muse Spark 1.2	0.0000	$44.95	118.1M	616k	6h 24m	354	2
30	Kimi K3	0.0000	$228.55	670.7M	1.4M	19h 8m	1408	3
31	Inkling	0.0000	$14.81	15.3M	75k	53m	223	1
32	GPT-5.6	0.0000†	$7.45	8.9M	65k	25m	65	3
33	GLM-5.3	0.0000	$251.10	909.6M	1.3M	19h 55m	1918	6
34	Qwen3.8-Max	0.0000	$121.10	426.7M	2.2M	19h 59m	984	1
35	Grok 4.6	0.0000	$271.55	264.4M	2.0M	9h 49m	1061	31
36	Muse Spark 1.2	0.0000	$10.77	39.0M	388k	1h 41m	164	4
37	DeepSeek V4 Flash Vision Exp	0.0000	$22.43	1385.4M	2.0M	11h 31m	2860	2
38	Qwen3.8-Max	0.0000	$135.25	480.8M	2.3M	19h 7m	1081	2
39	Qwen3.8-Max	0.0000	$60.45	189.1M	2.1M	19h 48m	599	3
40	Qwen3.8-Max	0.0000	$31.00	87.6M	1.4M	13h 21m	385	6
41	Inkling	0.0000	$7.91	8.2M	23k	26m	165	2
42	Grok 4.6	0.0000	$676.54	663.0M	4.1M	19h 59m	2429	277
43	GPT-5.6	0.0000	$127.72	124.4M	217k	2h 5m	382	24
44	Muse Spark 1.2	0.0000	$4.46	22.6M	149k	52m	145	2
45	DeepSeek V4 Flash Vision Exp	0.0000	$18.34	1059.5M	2.2M	17h 1m	2383	9
46	GPT-5.6	0.0000	$24.84	37.1M	163k	1h 9m	219	13
47	Grok 4.6	0.0000	$250.76	240.6M	2.1M	11h 13m	930	16
48	Muse Spark 1.2	0.0000	$22.61	124.4M	368k	1h 49m	323	2
49	Muse Spark 1.2	0.0000	$12.00	53.2M	328k	1h 52m	189	2
50	GPT-5.6	0.0000	$20.50	39.9M	168k	1h 9m	231	7

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.