Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Vision-only TORCS Racing Bot

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Opus 5.5	0.5284	$75.38	280.1M	713k	17h 50m	688	10
2	Claude Opus 5.5	0.5076	$73.95	265.4M	548k	18h 0m	556	10
3	GPT-6 Astra	0.4570	$770.42	373.2M	731k	19h 37m	1013	12
4	Claude Sonnet 5.5	0.4341	$69.62	285.7M	942k	19h 8m	690	6
5	GPT-6 Astra	0.3866	$1781.91	865.7M	1.5M	19h 55m	2133	25
6	Claude Sonnet 5.5	0.3811	$72.87	292.1M	964k	18h 50m	741	7
7	Claude Fable 5.1	0.3604	$65.32	119.8M	246k	14h 32m	399	16
8	Claude Fable 5.1	0.3524	$77.13	147.0M	311k	14h 51m	472	5
9	Claude Opus 5	0.3059	$79.30	127.1M	413k	18h 52m	388	8
10	Claude Sonnet 5.5	0.3045	$106.43	367.7M	1.1M	19h 5m	793	2
11	GPT-6 Astra	0.2803	$1564.06	755.2M	1.2M	19h 40m	1857	16
12	Claude Fable 5.1	0.2715	$77.56	137.7M	370k	10h 32m	426	7
13	Claude Opus 5.5	0.2616	$101.33	304.1M	515k	18h 58m	609	10
14	Claude Fable 5.1	0.2491	$104.18	191.5M	350k	15h 56m	562	8
15	Claude Sonnet 5.5	0.2220	$57.01	213.8M	846k	19h 22m	546	3
16	Claude Sonnet 5.5	0.2007	$76.43	316.3M	994k	19h 1m	751	7
17	Claude Fable 5	0.1944	$174.39	145.2M	388k	18h 8m	447	8
18	Claude Fable 5.1	0.1812	$69.87	126.5M	304k	15h 13m	418	9
19	Claude Opus 5	0.1513	$87.00	142.2M	403k	18h 34m	374	4
20	Claude Haiku 5.5	0.1276	$10.82	179.6M	761k	18h 58m	410	1
21	GPT-5.6 Sol	0.1207	$165.68	160.5M	163k	9h 38m	416	7
22	Grok 4.6	0.1206	$114.81	93.3M	882k	19h 41m	426	10
23	Qwen3.8-Max	0.1078	$31.56	67.3M	1.0M	19h 45m	456	2
24	Claude Opus 5	0.1073	$79.88	127.0M	429k	18h 13m	353	6
25	GPT-6 Astra	0.1048	$823.35	394.4M	766k	19h 59m	1018	14
26	GPT-6 Astra	0.0879	$1737.29	826.0M	1.5M	19h 53m	1937	16
27	Gemini 3.8 Flash	0.0797	$10.30	67.6M	209k	3h 53m	315	3
28	Claude Opus 5	0.0711	$105.95	145.9M	442k	17h 1m	380	4
29	DeepSeek V4 Flash Vision Exp	0.0671	$3.79	218.1M	451k	16h 2m	591	4
30	Kimi K3	0.0612	$51.38	138.7M	388k	19h 16m	456	9
31	Inkling	0.0559	$112.11	117.1M	218k	1h 53m	811	1
32	Claude Opus 5	0.0519	$94.80	144.0M	475k	17h 47m	401	7
33	Claude Haiku 5.5	0.0509	$4.70	70.8M	425k	18h 17m	231	2
34	GLM-5.3	0.0490	$52.08	118.9M	330k	18h 59m	354	2
35	Grok 4.7	0.0456	$436.54	434.7M	834k	19h 58m	1732	29
36	Claude Haiku 5.5	0.0451	$7.98	105.3M	596k	12h 11m	305	4
37	DeepSeek V4 Flash Vision Exp	0.0421	$4.04	235.7M	470k	19h 34m	605	5
38	GLM-5.3	0.0406	$79.08	158.6M	318k	18h 36m	406	8
39	Gemini 3.8 Flash	0.0405	$9.72	57.7M	157k	3h 40m	286	3
40	Muse Spark 1.3	0.0388	$56.56	261.0M	256k	19h 53m	846	5
41	Qwen3.8-Max	0.0385	$33.83	72.9M	764k	18h 52m	422	2
42	Claude Haiku 5.5	0.0383	$8.88	146.9M	548k	11h 16m	356	4
43	Kimi K3	0.0382	$61.72	163.7M	377k	19h 53m	534	3
44	GLM-5.3	0.0363	$101.89	234.7M	397k	19h 55m	487	1
45	Gemini 3.8 Flash	0.0345	$10.37	85.8M	196k	4h 25m	340	2
46	Grok 4.6	0.0335	$207.50	166.7M	1.1M	18h 40m	692	23
47	GLM-5.3	0.0278	$99.55	248.0M	367k	18h 54m	563	14
48	Gemini 3.7 Flash	0.0235	$5.06	24.8M	145k	2h 40m	197	1
49	Qwen3.8-Max	0.0216	$32.92	71.7M	721k	19h 16m	425	2
50	Kimi K3	0.0211	$44.44	114.5M	382k	20h 0m	386	1
51	Inkling	0.0186	$4.32	4.4M	39k	1h 1m	122	1
52	GLM-5.3	0.0180	$78.52	153.1M	353k	18h 42m	396	9
53	DeepSeek V4 Flash Vision Exp	0.0178	$3.85	221.0M	459k	11h 59m	555	7
54	Claude Haiku 5.5	0.0166	$6.71	95.4M	457k	13h 37m	272	2
55	Muse Spark 1.3	0.0144	$191.47	315.7M	497k	17h 52m	814	9
56	Kimi K3	0.0143	$59.95	154.4M	389k	20h 1m	507	2
57	Gemini 3.8 Flash	0.0136	$14.12	129.4M	330k	4h 0m	401	3
58	Muse Spark 1.2	0.0135	$59.82	110.7M	431k	11h 54m	331	6
59	GLM-5.3 Flash	0.0132	$3.71	111.1M	281k	17h 16m	405	3
60	Inkling	0.0129	$1.44	1.4M	20k	2h 0m	84	1
61	GLM-5.3 Flash	0.0128	$10.01	163.4M	383k	19h 11m	520	8
62	Muse Spark 1.2	0.0128	$52.14	70.4M	490k	14h 49m	289	4
63	Gemini 3.7 Flash	0.0127	$18.66	92.0M	417k	5h 34m	318	2
64	Grok 4.6	0.0122	$159.04	128.5M	975k	18h 46m	569	20
65	Gemini 3.7 Flash	0.0121	$11.51	63.9M	262k	4h 49m	310	2
66	Gemini 3.7 Flash	0.0118	$6.81	26.5M	177k	3h 38m	183	2
67	DeepSeek V4 Flash Vision Exp	0.0114	$4.73	279.3M	524k	19h 31m	681	4
68	GLM-5.3 Flash	0.0065	$8.04	140.3M	327k	17h 4m	460	6
69	Qwen3.8-Max	0.0061	$53.75	151.0M	965k	20h 0m	695	2
70	GLM-5.3 Flash	0.0056	$7.97	164.9M	369k	18h 14m	550	6
71	Muse Spark 1.2	0.0051	$32.90	57.9M	354k	9h 41m	372	3
72	GLM-5.3 Flash	0.0050	$8.45	168.8M	413k	16h 34m	519	5
73	Grok 4.6	0.0043	$218.28	183.9M	1.3M	14h 37m	752	15
74	Gemini 3.7 Flash	0.0041	$7.39	32.0M	185k	3h 17m	213	1
75	Inkling	0.0031	$5.44	5.4M	67k	1h 58m	120	2
76	Muse Spark 1.3	0.0029	$53.07	279.6M	311k	19h 59m	985	11
77	Inkling	0.0025	$2.42	2.4M	30k	2h 1m	89	2
78	Qwen3.8-Max-0902	0.0000†	$21.92	49.4M	903k	20h 6m	303	2
79	Muse Spark 1.3	0.0000†	$28.04	94.3M	152k	18h 59m	469	5
80	Gemini 4 Argon	0.0000†	$81.71	58.0M	243k	8h 45m	180	3
81	DeepSeek V4 Flash Vision Exp	0.0000†	$2.30	127.9M	331k	19h 43m	454	3
82	Grok 4.7	0.0000†	$129.68	133.6M	655k	14h 50m	603	11
83	Claude Opus 5.5	0.0000†	$60.58	240.2M	450k	18h 1m	571	11
84	Gemini 4 Argon	0.0000†	$54.62	48.6M	203k	6h 19m	169	2
85	Qwen3.8-Max-0902	0.0000†	$25.56	62.5M	975k	20h 8m	424	1
86	Qwen3.8-Max-0902	0.0000†	$48.14	156.8M	904k	19h 44m	531	1
87	Gemini 4 Argon	0.0000†	$123.80	83.2M	286k	8h 31m	204	3
88	Claude Fable 5	0.0000†	$81.94	61.7M	264k	17h 37m	293	2
89	GPT-5.6 Sol	0.0000†	$58.14	63.0M	111k	13h 6m	288	4
90	GPT-5.6 Sol	0.0000†	$25.75	38.4M	104k	16h 16m	218	4
91	Gemini 4 Argon	0.0000†	$78.71	63.3M	288k	10h 39m	188	5
92	Grok 4.7	0.0000†	$87.58	84.0M	222k	5h 40m	303	8
93	Grok 4.6	0.0000†	$57.50	52.5M	468k	7h 59m	252	3
94	Claude Fable 5	0.0000†	$92.42	70.7M	286k	18h 32m	313	5
95	Qwen3.8-Max	0.0000†	$18.02	51.8M	431k	20h 1m	433	2
96	Qwen3.8-Max-0902	0.0000†	$26.82	62.8M	787k	20h 4m	353	1
97	GPT-5.6 Sol	0.0000†	$51.99	57.9M	124k	4h 17m	277	6
98	Gemini 3.8 Flash	0.0000†	$7.30	51.8M	173k	3h 58m	288	4
99	GPT-5.6 Sol	0.0000†	$79.43	80.8M	113k	10h 50m	285	4
100	Qwen3.8-Max-0902	0.0000†	$28.34	75.5M	595k	20h 1m	372	1
101	Kimi K3	0.0000†	$56.92	159.4M	376k	20h 0m	521	1
102	Grok 4.7	0.0000†	$51.73	43.4M	216k	3h 56m	182	5
103	Muse Spark 1.3	0.0000†	$90.60	82.5M	232k	18h 53m	410	3
104	Claude Fable 5	0.0000†	$85.34	65.1M	256k	19h 10m	286	3
105	Gemini 4 Argon	0.0000†	$96.39	87.4M	314k	10h 9m	198	3
106	Muse Spark 1.2	0.0000†	$35.10	65.9M	265k	9h 20m	229	3
107	Grok 4.7	0.0000†	$353.91	323.1M	770k	19h 55m	1185	13
108	Claude Opus 5.5	0.0000†	$51.68	197.1M	439k	16h 52m	474	7
109	Muse Spark 1.2	0.0000†	$27.43	124.8M	316k	10h 1m	385	4
110	Claude Fable 5	0.0000†	$105.01	80.0M	325k	19h 12m	309	2

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.