Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Reconnaissance Blind Chess Recovery

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Opus 5.5	0.9929	$30.52	100.2M	393k	11h 17m	272	6
2	Claude Sonnet 5.5	0.9857	$55.39	234.7M	652k	13h 43m	437	4
3	GPT-6 Astra	0.9857	$244.69	120.7M	324k	13h 51m	408	10
4	Claude Opus 5.5	0.9786	$45.44	160.9M	500k	13h 11m	377	11
5	Claude Opus 5.5	0.9786	$34.33	116.2M	417k	11h 0m	318	8
6	Claude Sonnet 5.5	0.9750	$40.76	168.9M	538k	13h 54m	374	7
7	Claude Opus 5.5	0.9750	$38.61	139.5M	396k	12h 25m	373	6
8	Claude Sonnet 5.5	0.9643	$41.04	170.2M	534k	12h 48m	351	2
9	Claude Opus 5.5	0.9571	$39.47	142.7M	408k	13h 40m	381	7
10	Claude Fable 5.1	0.9536	$56.70	98.3M	311k	9h 23m	314	7
11	Claude Sonnet 5.5	0.9536	$50.70	214.9M	589k	14h 7m	425	5
12	Claude Fable 5.1	0.9536	$46.08	78.9M	273k	10h 59m	276	9
13	Claude Fable 5	0.9500	$67.06	43.5M	324k	14h 13m	175	3
14	Claude Sonnet 5.5	0.9464	$44.69	183.2M	625k	13h 17m	361	3
15	Claude Opus 5	0.9429	$45.45	65.6M	338k	12h 24m	221	3
16	Claude Fable 5.1	0.9429	$31.38	51.1M	239k	11h 53m	233	6
17	GPT-6 Astra	0.9429	$571.36	274.8M	479k	10h 52m	637	7
18	Claude Fable 5	0.9357	$59.50	39.9M	266k	13h 11m	181	6
19	Gemini 4 Argon	0.9286	$102.13	88.3M	440k	7h 8m	224	7
20	Gemini 4 Argon	0.9214	$93.51	158.0M	759k	9h 17m	426	13
21	Gemini 4 Argon	0.8964	$116.54	131.7M	765k	9h 49m	373	8
22	Gemini 4 Argon	0.8893	$85.61	94.9M	445k	9h 1m	199	6
23	GPT-5.6 Sol	0.8893	$28.42	45.1M	149k	6h 33m	291	7
24	Claude Fable 5	0.8821	$103.72	80.8M	300k	11h 27m	277	6
25	Claude Opus 5	0.8750	$46.27	65.7M	362k	13h 32m	222	5
26	Gemini 4 Argon	0.8679	$74.43	68.7M	419k	7h 35m	192	4
27	GPT-5.6 Sol	0.8607	$35.99	57.3M	138k	6h 13m	336	13
28	Grok 4.7	0.8571	$107.31	95.1M	427k	11h 56m	400	26
29	Claude Opus 5	0.8500	$61.18	94.0M	386k	14h 7m	294	4
30	Claude Opus 5	0.8429	$60.29	91.4M	395k	14h 7m	252	7
31	GPT-6 Astra	0.8429	$330.64	163.8M	407k	12h 13m	526	9
32	Claude Fable 5.1	0.8357	$41.84	71.9M	245k	9h 32m	252	11
33	GPT-6 Astra	0.8357	$771.41	367.5M	716k	14h 57m	903	12
34	Claude Haiku 5.5	0.8071	$9.96	166.2M	583k	11h 28m	342	6
35	GPT-5.6 Sol	0.8071	$20.62	32.5M	99k	10h 50m	196	10
36	GPT-5.6 Sol	0.8000	$20.53	30.5M	123k	2h 52m	197	3
37	Claude Fable 5.1	0.7929	$38.22	64.0M	257k	7h 37m	245	4
38	Grok 4.7	0.7821	$110.91	86.8M	288k	10h 45m	306	21
39	Claude Opus 5	0.7643	$37.81	52.1M	323k	13h 43m	213	4
40	Claude Fable 5	0.7607	$96.29	69.5M	362k	13h 19m	226	7
41	Kimi K3	0.7571	$29.23	77.1M	277k	14h 20m	314	2
42	GPT-6 Astra	0.7536	$12.03	4.8M	92k	34m	69	3
43	GPT-5.6 Sol	0.7357	$15.51	21.1M	106k	11h 38m	168	9
44	Grok 4.7	0.7250	$43.26	41.6M	230k	3h 58m	188	3
45	Claude Haiku 5.5	0.6857	$6.75	107.9M	485k	12h 11m	273	4
46	Claude Fable 5	0.6750	$77.86	54.6M	319k	13h 7m	214	4
47	Claude Haiku 5.5	0.6321	$6.72	103.6M	558k	12h 23m	236	4
48	Grok 4.6	0.6036	$87.29	70.2M	604k	8h 33m	259	9
49	Grok 4.7	0.5893	$172.69	157.2M	497k	15h 0m	627	13
50	Grok 4.6	0.5857	$104.51	99.3M	819k	14h 17m	453	24
51	Grok 4.7	0.5607	$45.18	44.4M	217k	3h 31m	197	8
52	Gemini 3.8 Flash	0.5536	$30.25	260.8M	509k	6h 38m	614	3
53	GLM-5.3	0.5357	$48.03	138.0M	410k	14h 33m	388	9
54	GLM-5.3 Flash	0.5250	$5.04	80.8M	333k	14h 2m	284	2
55	Kimi K3	0.5071	$31.51	82.4M	325k	14h 46m	311	4
56	Gemini 3.8 Flash	0.4714	$27.99	242.3M	700k	9h 7m	669	6
57	Muse Spark 1.3	0.4500	$83.30	135.3M	1.0M	14h 48m	459	4
58	Gemini 3.8 Flash	0.4500	$19.92	177.3M	430k	4h 7m	478	3
59	Kimi K3	0.4286	$27.43	64.3M	286k	14h 50m	256	11
60	Gemini 3.7 Flash	0.4250	$12.09	51.0M	293k	4h 11m	266	3
61	GLM-5.3	0.4214	$29.52	79.9M	302k	14h 26m	305	6
62	Grok 4.6	0.4071	$107.37	99.7M	852k	13h 36m	443	17
63	Muse Spark 1.2	0.4036	$5.41	24.7M	331k	4h 44m	150	2
64	Muse Spark 1.2	0.4036	$6.73	30.6M	391k	4h 23m	132	4
65	Muse Spark 1.2	0.3750	$11.18	57.5M	431k	6h 54m	254	6
66	GLM-5.3	0.3607	$36.05	73.5M	339k	13h 30m	259	4
67	Claude Haiku 5.5	0.3571	$5.00	75.9M	441k	13h 8m	222	3
68	Muse Spark 1.2	0.3429	$9.01	40.4M	451k	7h 47m	197	4
69	Claude Haiku 5.5	0.3357	$5.64	87.4M	456k	13h 10m	240	2
70	Kimi K3	0.3143	$28.91	69.9M	341k	12h 50m	253	2
71	Gemini 3.8 Flash	0.3107	$28.23	250.7M	518k	4h 50m	551	4
72	Gemini 3.7 Flash	0.3000	$23.11	214.3M	578k	5h 22m	524	1
73	GLM-5.3	0.2893	$25.26	83.8M	284k	14h 38m	339	4
74	Grok 4.6	0.2786	$78.34	65.1M	979k	10h 29m	301	8
75	GLM-5.3	0.2571	$27.02	69.8M	315k	14h 43m	253	6
76	Gemini 3.7 Flash	0.2393	$20.54	111.4M	562k	4h 43m	327	1
77	Qwen3.8-Max-0902	0.2321	$22.10	36.7M	1.2M	15h 6m	239	1
78	GLM-5.3 Flash	0.2214	$3.70	65.2M	342k	14h 4m	250	2
79	Muse Spark 1.2	0.2071	$9.69	39.5M	748k	4h 22m	138	7
80	Inkling	0.2000	$1.23	1.2M	15k	1h 37m	46	1
81	DeepSeek V4 Flash Vision Exp	0.1786	$2.02	107.0M	337k	14h 34m	328	2
82	Kimi K3	0.1429	$43.61	116.1M	397k	14h 40m	395	2
83	Qwen3.8-Max	0.1357	$20.20	59.6M	794k	13h 51m	345	3
84	Gemini 3.8 Flash	0.1214	$31.55	253.4M	764k	12h 9m	734	2
85	DeepSeek V4 Flash Vision Exp	0.1214	$2.99	164.7M	448k	8h 44m	423	5
86	GLM-5.3 Flash	0.1214	$5.52	97.5M	412k	13h 40m	313	9
87	Muse Spark 1.3	0.1107	$38.26	178.6M	566k	18h 5m	654	36
88	Grok 4.6	0.0929	$172.71	159.1M	1.1M	14h 32m	609	14
89	Qwen3.8-Max-0902	0.0929	$21.34	36.0M	1.2M	15h 8m	263	1
90	Inkling	0.0786	$1.37	1.4M	14k	43m	62	1
91	Qwen3.8-Max	0.0750	$16.70	49.8M	638k	13h 27m	335	3
92	Qwen3.8-Max-0902	0.0607	$20.03	44.0M	1.0M	15h 2m	256	1
93	Qwen3.8-Max	0.0536	$12.92	35.1M	623k	13h 47m	238	3
94	Gemini 3.7 Flash	0.0536	$30.51	186.7M	1.3M	5h 45m	513	2
95	Qwen3.8-Max	0.0536	$22.79	70.5M	780k	13h 7m	415	3
96	GLM-5.3 Flash	0.0500	$3.94	72.4M	357k	14h 22m	251	2
97	Gemini 3.7 Flash	0.0429	$30.88	192.0M	568k	8h 45m	506	2
98	Qwen3.8-Max-0902	0.0429	$15.23	34.3M	1.0M	15h 2m	220	1
99	Inkling	0.0393	$5.27	5.4M	45k	1h 49m	127	2
100	DeepSeek V4 Flash Vision Exp	0.0357	$2.71	145.6M	448k	14h 17m	377	7
101	Muse Spark 1.3	0.0286	$195.94	191.4M	452k	19h 7m	684	7
102	GLM-5.3 Flash	0.0179	$4.71	110.5M	429k	14h 10m	330	7
103	DeepSeek V4 Flash Vision Exp	0.0143	$2.49	130.6M	440k	11h 4m	400	10
104	Inkling	0.0143	$2.10	2.1M	21k	28m	83	1
105	Qwen3.8-Max-0902	0.0143	$12.30	21.2M	813k	15h 8m	188	1
106	Muse Spark 1.3	0.0107	$34.91	148.6M	508k	14h 14m	577	15
107	Qwen3.8-Max	0.0071	$26.05	82.8M	805k	13h 22m	436	3
108	DeepSeek V4 Flash Vision Exp	0.0036	$2.74	145.9M	463k	9h 28m	372	6
109	Muse Spark 1.3	0.0036	$74.56	160.5M	728k	11h 20m	628	10
110	Inkling	0.0000	$3.91	4.0M	36k	2h 12m	98	2