Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Snooker Prediction

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.6319	$2653.82	1245.9M	2.6M	19h 52m	2769	39
2	GPT-6 Astra	0.6316	$2364.83	1112.0M	2.4M	19h 31m	2539	51
3	GPT-6 Astra	0.6308	$1877.69	889.9M	1.7M	16h 9m	1997	31
4	GPT-6 Astra	0.6304	$348.12	162.7M	418k	3h 11m	442	4
5	Claude Opus 5.5	0.6243	$92.07	333.9M	907k	9h 5m	810	28
6	Gemini 4 Argon	0.6242	$58.63	165.8M	890k	6h 8m	418	2
7	GPT-6 Astra	0.6223	$321.27	149.5M	395k	3h 5m	401	4
8	Claude Opus 5.5	0.6219	$106.45	401.8M	928k	15h 53m	977	39
9	Claude Sonnet 5.5	0.6210	$169.39	673.2M	2.7M	19h 1m	1510	2
10	Claude Opus 5.5	0.6162	$99.16	365.9M	934k	14h 38m	876	24
11	Claude Sonnet 5.5	0.6129	$163.92	638.8M	2.8M	17h 56m	1433	20
12	Claude Sonnet 5.5	0.6127	$143.11	580.3M	2.1M	18h 52m	1315	29
13	Claude Sonnet 5.5	0.6036	$144.28	579.6M	2.2M	18h 20m	1325	8
14	Gemini 4 Argon	0.5920	$39.04	128.3M	687k	6h 49m	357	3
15	Claude Sonnet 5.5	0.5773	$121.18	495.6M	1.7M	19h 1m	1108	10
16	Claude Opus 5.5	0.5538	$119.85	454.9M	1.0M	14h 11m	1016	41
17	Gemini 4 Argon	0.5407	$63.97	191.0M	855k	6h 41m	464	3
18	Claude Opus 5.5	0.5128	$94.50	346.2M	909k	11h 7m	864	12
19	Claude Fable 5.1	0.5126	$87.17	154.8M	404k	6h 52m	408	12
20	Claude Opus 5	0.5001	$197.63	316.4M	1.0M	15h 45m	730	24
21	Claude Fable 5.1	0.4984	$96.24	173.0M	403k	7h 34m	486	21
22	GPT-5.6 Sol	0.4857	$119.18	111.7M	242k	2h 5m	299	11
23	GPT-5.6 Sol	0.4839	$170.16	165.0M	275k	4h 12m	432	9
24	Claude Fable 5.1	0.4822	$86.06	152.3M	409k	8h 44m	402	23
25	Claude Fable 5.1	0.4767	$88.31	156.7M	413k	3h 39m	397	10
26	Claude Opus 5	0.4607	$210.30	340.0M	1.1M	18h 37m	821	19
27	Gemini 4 Argon	0.4552	$134.67	137.5M	744k	5h 5m	372	3
28	GPT-5.6 Sol	0.4428	$157.87	150.8M	208k	2h 34m	354	9
29	Claude Fable 5	0.4405	$329.75	265.7M	842k	18h 32m	627	21
30	Claude Opus 5	0.4307	$172.30	276.6M	886k	18h 12m	665	10
31	GPT-5.6 Sol	0.4295	$132.32	126.4M	240k	4h 1m	369	6
32	Claude Haiku 5.5	0.4124	$12.19	184.2M	1.1M	9h 13m	452	3
33	Muse Spark 1.3	0.3826	$317.27	411.4M	767k	19h 50m	1032	4
34	Grok 4.6	0.3789	$466.11	391.2M	2.0M	19h 43m	1488	73
35	Claude Fable 5.1	0.3738	$86.02	153.2M	388k	5h 28m	424	9
36	Claude Fable 5	0.3600	$264.94	218.2M	625k	12h 41m	435	18
37	Muse Spark 1.3	0.3439	$236.90	672.0M	957k	19h 49m	1569	5
38	Claude Fable 5	0.3089	$197.41	157.5M	532k	18h 2m	369	13
39	Claude Haiku 5.5	0.3050	$9.22	147.7M	647k	7h 56m	307	2
40	Grok 4.6	0.3048	$106.12	86.0M	725k	5h 58m	378	5
41	GPT-5.6 Sol	0.2890	$179.27	154.6M	213k	9h 23m	357	5
42	Claude Haiku 5.5	0.2612	$6.70	101.8M	570k	4h 14m	252	2
43	Claude Opus 5	0.2573	$170.72	274.5M	864k	18h 25m	685	12
44	Claude Haiku 5.5	0.2379	$13.72	212.9M	1.2M	10h 26m	529	24
45	Gemini 4 Argon	0.2214	$64.59	161.0M	705k	6h 32m	420	3
46	GLM-5.3	0.1976	$71.12	251.5M	765k	18h 56m	654	15
47	Grok 4.6	0.1779	$108.45	87.9M	851k	6h 23m	344	15
48	Claude Fable 5	0.1348	$215.61	174.0M	561k	17h 21m	402	12
49	Claude Haiku 5.5	0.1195	$6.94	107.1M	566k	4h 29m	260	2
50	Grok 4.6	0.1175	$125.27	104.6M	768k	11h 27m	446	9
51	Gemini 3.8 Flash	0.1105	$14.99	133.6M	331k	1h 42m	403	3
52	GLM-5.3	0.1013	$57.78	201.7M	793k	14h 16m	531	13
53	Qwen3.8-Max	0.0882	$56.82	135.8M	1.2M	18h 54m	506	1
54	Gemini 3.8 Flash	0.0820	$13.08	117.4M	334k	1h 20m	368	3
55	Claude Opus 5	0.0762	$115.37	188.1M	559k	19h 9m	407	11
56	GLM-5.3	0.0590	$53.37	163.6M	430k	17h 18m	373	6
57	Muse Spark 1.3	0.0370	$445.62	445.7M	615k	19h 19m	857	8
58	Qwen3.8-Max-0902	0.0341	$31.78	57.0M	1.5M	20h 7m	298	1
59	Inkling	0.0335	$2.61	2.6M	26k	1h 16m	72	2
60	GLM-5.3	0.0311	$89.97	246.3M	519k	19h 15m	495	13
61	Claude Fable 5	0.0276	$244.97	201.6M	586k	17h 26m	457	16
62	Qwen3.8-Max-0902	0.0275	$32.69	59.4M	1.3M	20h 2m	303	1
63	Grok 4.6	0.0252	$77.16	60.3M	816k	4h 29m	271	13
64	Inkling	0.0203	$2.91	2.9M	46k	1h 53m	87	2
65	Grok 4.7	0.0086	$81.17	79.8M	486k	3h 8m	332	5
66	Kimi K3	0.0000	$126.53	346.0M	738k	19h 31m	778	8
67	Muse Spark 1.3	0.0000	$518.18	574.1M	1.1M	19h 44m	1290	6
68	Qwen3.8-Max	0.0000	$80.65	199.9M	2.1M	18h 39m	673	1
69	Gemini 3.7 Flash	0.0000	$7.82	66.5M	374k	1h 5m	279	1
70	Grok 4.7	0.0000	$342.95	338.0M	1.2M	19h 47m	1370	39
71	Qwen3.8-Max-0902	0.0000	$38.36	77.8M	1.3M	20h 2m	345	1
72	Gemini 3.7 Flash	0.0000	$8.33	59.1M	343k	2h 40m	282	3
73	Inkling	0.0000	$3.24	3.2M	40k	1h 45m	103	1
74	Gemini 3.7 Flash	0.0000	$5.61	40.2M	288k	59m	224	2
75	Gemini 3.8 Flash	0.0000	$8.11	76.9M	253k	1h 6m	299	5
76	Qwen3.8-Max-0902	0.0000	$30.67	66.2M	1.6M	20h 2m	268	1
77	Muse Spark 1.2	0.0000	$26.92	100.5M	603k	1h 48m	377	5
78	DeepSeek V4 Flash Vision Exp	0.0000	$4.83	277.6M	638k	5h 11m	644	13
79	Muse Spark 1.2	0.0000	$12.08	49.7M	275k	1h 6m	250	8
80	DeepSeek V4 Flash Vision Exp	0.0000	$3.23	179.6M	479k	19h 58m	466	1
81	GLM-5.3 Flash	0.0000	$8.45	217.9M	542k	13h 37m	520	3
82	DeepSeek V4 Flash Vision Exp	0.0000	$3.55	189.8M	629k	6h 0m	485	3
83	Qwen3.8-Max	0.0000	$115.97	289.9M	2.1M	19h 35m	811	1
84	Qwen3.8-Max	0.0000	$102.79	307.3M	1.7M	19h 10m	794	2
85	Gemini 3.7 Flash	0.0000	$6.64	48.6M	323k	1h 55m	247	1
86	Grok 4.7	0.0000	$282.03	285.1M	1.2M	19h 51m	1191	49
87	Qwen3.8-Max-0902	0.0000	$28.07	61.6M	1.3M	20h 0m	287	1
88	Kimi K3	0.0000	$140.38	372.9M	1.4M	19h 51m	925	26
89	Gemini 3.8 Flash	0.0000	$8.70	83.2M	282k	1h 15m	312	1
90	Inkling	0.0000	$2.84	2.7M	69k	45m	82	2
91	Muse Spark 1.2	0.0000	$16.11	78.5M	517k	1h 19m	309	4
92	Qwen3.8-Max	0.0000	$61.40	180.5M	1.6M	20h 1m	551	1
93	GLM-5.3 Flash	0.0000	$10.25	278.8M	597k	10h 31m	596	8
94	Inkling	0.0000	$1.80	1.8M	26k	14m	79	2
95	Muse Spark 1.2	0.0000	$13.70	75.9M	319k	1h 35m	305	3
96	GLM-5.3 Flash	0.0000	$13.39	288.1M	552k	17h 55m	640	19
97	Grok 4.7	0.0000	$61.25	64.2M	387k	4h 4m	335	5
98	Kimi K3	0.0000	$122.14	346.5M	798k	19h 47m	793	8
99	Gemini 3.7 Flash	0.0000	$7.40	56.9M	413k	1h 21m	266	2
100	DeepSeek V4 Flash Vision Exp	0.0000	$4.28	248.4M	549k	14h 16m	593	8
101	Kimi K3	0.0000	$117.31	316.7M	1.0M	19h 47m	806	6
102	Kimi K3	0.0000	$105.21	273.3M	660k	20h 0m	548	3
103	Grok 4.7	0.0000	$79.86	85.0M	390k	6h 4m	384	13
104	Gemini 3.8 Flash	0.0000	$17.30	177.6M	409k	1h 51m	471	5
105	Muse Spark 1.3	0.0000	$449.88	491.2M	832k	19h 52m	1176	2
106	GLM-5.3 Flash	0.0000	$7.94	248.0M	455k	19h 56m	595	7
107	GLM-5.3	0.0000	$94.15	290.7M	465k	18h 52m	627	11
108	DeepSeek V4 Flash Vision Exp	0.0000	$5.35	314.7M	642k	14h 37m	709	3
109	GLM-5.3 Flash	0.0000	$12.92	278.9M	847k	19h 47m	687	1
110	Muse Spark 1.2	0.0000	$16.58	87.1M	508k	2h 14m	321	6