Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Snooker Prediction

task page →50 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.5126	$87.17	154.8M	404k	6h 52m	408	12
2	Claude Fable 5.1	0.4984	$96.24	173.0M	403k	7h 34m	486	21
3	GPT-5.6	0.4857	$119.18	111.7M	242k	2h 5m	299	11
4	GPT-5.6	0.4839	$170.16	165.0M	275k	4h 12m	432	9
5	Claude Fable 5.1	0.4822	$86.06	152.3M	409k	8h 44m	402	23
6	Claude Fable 5.1	0.4767	$88.31	156.7M	413k	3h 39m	397	10
7	GPT-5.6	0.4428	$157.87	150.8M	208k	2h 34m	354	9
8	GPT-5.6	0.4295	$132.32	126.4M	240k	4h 1m	369	6
9	Grok 4.6	0.3789	$466.11	391.2M	2.0M	19h 43m	1488	73
10	Claude Fable 5.1	0.3738	$86.02	153.2M	388k	5h 28m	424	9
11	Grok 4.6	0.3048	$106.12	86.0M	725k	5h 58m	378	5
12	GPT-5.6	0.2890	$179.27	154.6M	213k	9h 23m	357	5
13	GLM-5.3	0.1976	$71.12	251.5M	765k	18h 56m	654	15
14	Grok 4.6	0.1779	$108.45	87.9M	851k	6h 23m	344	15
15	Grok 4.6	0.1175	$125.27	104.6M	768k	11h 27m	446	9
16	GLM-5.3	0.1013	$57.78	201.7M	793k	14h 16m	531	13
17	Qwen3.8-Max	0.0882	$56.82	135.8M	1.2M	18h 54m	506	1
18	GLM-5.3	0.0590	$53.37	163.6M	430k	17h 18m	373	6
19	Inkling	0.0335	$2.61	2.6M	26k	1h 16m	72	2
20	GLM-5.3	0.0311	$89.97	246.3M	519k	19h 15m	495	13
21	Grok 4.6	0.0252	$77.16	60.3M	816k	4h 29m	271	13
22	Inkling	0.0203	$2.91	2.9M	46k	1h 53m	87	2
23	Kimi K3	0.0000	$126.53	346.0M	738k	19h 31m	778	8
24	Qwen3.8-Max	0.0000	$80.65	199.9M	2.1M	18h 39m	673	1
25	Gemini 3.7 Flash	0.0000	$7.82	66.5M	374k	1h 5m	279	1
26	Gemini 3.7 Flash	0.0000	$8.33	59.1M	343k	2h 40m	282	3
27	Inkling	0.0000	$3.24	3.2M	40k	1h 45m	103	1
28	Gemini 3.7 Flash	0.0000	$5.61	40.2M	288k	59m	224	2
29	Muse Spark 1.2	0.0000	$26.92	100.5M	603k	1h 48m	377	5
30	DeepSeek V4 Flash Vision Exp	0.0000	$4.83	277.6M	638k	5h 11m	644	13
31	Muse Spark 1.2	0.0000	$12.08	49.7M	275k	1h 6m	250	8
32	DeepSeek V4 Flash Vision Exp	0.0000	$3.23	179.6M	479k	19h 58m	466	1
33	DeepSeek V4 Flash Vision Exp	0.0000	$3.55	189.8M	629k	6h 0m	485	3
34	Qwen3.8-Max	0.0000	$115.97	289.9M	2.1M	19h 35m	811	1
35	Qwen3.8-Max	0.0000	$102.79	307.3M	1.7M	19h 10m	794	2
36	Gemini 3.7 Flash	0.0000	$6.64	48.6M	323k	1h 55m	247	1
37	Kimi K3	0.0000	$140.38	372.9M	1.4M	19h 51m	925	26
38	Inkling	0.0000	$2.84	2.7M	69k	45m	82	2
39	Muse Spark 1.2	0.0000	$16.11	78.5M	517k	1h 19m	309	4
40	Qwen3.8-Max	0.0000	$61.40	180.5M	1.6M	20h 1m	551	1
41	Inkling	0.0000	$1.80	1.8M	26k	14m	79	2
42	Muse Spark 1.2	0.0000	$13.70	75.9M	319k	1h 35m	305	3
43	Kimi K3	0.0000	$122.14	346.5M	798k	19h 47m	793	8
44	Gemini 3.7 Flash	0.0000	$7.40	56.9M	413k	1h 21m	266	2
45	DeepSeek V4 Flash Vision Exp	0.0000	$4.28	248.4M	549k	14h 16m	593	8
46	Kimi K3	0.0000	$117.31	316.7M	1.0M	19h 47m	806	6
47	Kimi K3	0.0000	$105.21	273.3M	660k	20h 0m	548	3
48	GLM-5.3	0.0000	$94.15	290.7M	465k	18h 52m	627	11
49	DeepSeek V4 Flash Vision Exp	0.0000	$5.35	314.7M	642k	14h 37m	709	3
50	Muse Spark 1.2	0.0000	$16.58	87.1M	508k	2h 14m	321	6