Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Qubit Routing

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Opus 5.5	0.9241	$44.40	160.3M	462k	12h 19m	408	3
2	Claude Opus 5.5	0.9229	$49.89	183.1M	502k	16h 23m	427	10
3	GPT-6 Astra	0.9207	$412.86	201.8M	473k	7h 46m	595	12
4	GPT-6 Astra	0.9186	$1381.68	662.3M	1.4M	17h 52m	1621	26
5	GPT-6 Astra	0.9168	$2130.53	1024.2M	1.9M	19h 50m	2384	45
6	Claude Opus 5.5	0.9138	$40.04	137.9M	476k	14h 14m	374	13
7	Claude Sonnet 5.5	0.9132	$39.23	158.7M	579k	6h 58m	352	15
8	GPT-6 Astra	0.9131	$2239.25	1067.1M	2.1M	19h 57m	2429	54
9	Claude Opus 5.5	0.9052	$63.24	243.8M	546k	14h 55m	528	21
10	Claude Sonnet 5.5	0.9031	$82.69	337.6M	1.2M	18h 35m	761	1
11	Claude Sonnet 5.5	0.9003	$69.19	287.2M	925k	18h 59m	671	10
12	Claude Sonnet 5.5	0.8951	$50.53	209.6M	671k	12h 55m	412	7
13	Claude Sonnet 5.5	0.8940	$63.68	259.4M	928k	17h 26m	635	4
14	Claude Opus 5	0.8917	$57.70	85.6M	405k	15h 40m	277	6
15	Claude Fable 5.1	0.8857	$37.59	60.9M	295k	9h 18m	239	6
16	Claude Opus 5	0.8845	$64.52	99.6M	401k	17h 6m	313	3
17	GPT-6 Astra	0.8800	$604.79	292.5M	576k	8h 29m	715	11
18	Claude Opus 5.5	0.8783	$46.14	171.7M	451k	17h 18m	447	9
19	Claude Fable 5.1	0.8752	$40.65	67.2M	290k	7h 39m	274	9
20	Claude Haiku 5.5	0.8732	$11.20	186.6M	660k	13h 13m	398	1
21	Claude Fable 5.1	0.8680	$40.94	67.5M	295k	10h 23m	279	9
22	Claude Opus 5	0.8644	$47.78	71.9M	322k	17h 28m	282	6
23	Gemini 4 Argon	0.8617	$30.08	62.2M	527k	4h 53m	176	4
24	Claude Fable 5.1	0.8599	$41.23	67.7M	303k	9h 29m	256	9
25	Claude Haiku 5.5	0.8544	$5.81	88.2M	507k	6h 15m	252	3
26	Claude Fable 5	0.8542	$114.20	86.2M	385k	16h 7m	288	16
27	Claude Fable 5.1	0.8541	$59.53	101.1M	368k	11h 5m	353	7
28	Claude Opus 5	0.8538	$47.81	68.4M	372k	17h 11m	247	7
29	Claude Haiku 5.5	0.8532	$8.21	132.2M	569k	9h 50m	313	2
30	Gemini 4 Argon	0.8488	$43.62	67.5M	441k	6h 4m	194	5
31	Claude Opus 5	0.8444	$51.06	76.5M	351k	16h 37m	268	3
32	Claude Fable 5	0.8371	$94.87	69.6M	350k	17h 59m	274	7
33	Claude Haiku 5.5	0.8214	$7.68	123.8M	539k	9h 29m	317	2
34	Gemini 4 Argon	0.8155	$105.29	73.3M	505k	9h 43m	177	8
35	Gemini 4 Argon	0.7986	$85.40	56.4M	543k	6h 53m	150	4
36	Claude Haiku 5.5	0.7982	$10.12	165.9M	636k	11h 29m	354	3
37	Gemini 4 Argon	0.7982	$74.01	64.4M	466k	6h 51m	181	7
38	Claude Fable 5	0.7952	$83.84	60.4M	319k	16h 2m	237	9
39	GPT-5.6 Sol	0.7946	$58.77	77.9M	203k	6h 45m	423	8
40	Qwen3.8-Max-0902	0.7845	$41.21	136.5M	995k	20h 0m	480	2
41	GPT-5.6 Sol	0.7781	$75.11	86.9M	202k	10h 41m	410	11
42	Claude Fable 5	0.7664	$98.60	72.9M	355k	17h 31m	271	9
43	Qwen3.8-Max-0902	0.7658	$47.17	161.4M	937k	19h 56m	531	1
44	Claude Fable 5	0.7638	$95.31	70.8M	336k	16h 17m	265	7
45	Gemini 3.7 Flash	0.7591	$2.33	9.2M	139k	1h 43m	99	2
46	GLM-5.3	0.7535	$23.46	64.7M	277k	19h 3m	267	6
47	Kimi K3	0.7526	$40.44	107.3M	401k	19h 37m	387	17
48	Grok 4.6	0.7350	$123.13	116.9M	502k	9h 53m	414	28
49	Grok 4.7	0.7346	$28.62	27.0M	233k	2h 28m	119	7
50	GLM-5.3	0.7343	$45.48	90.2M	303k	16h 27m	365	4
51	GPT-5.6 Sol	0.7314	$114.07	131.6M	228k	8h 56m	569	14
52	Qwen3.8-Max-0902	0.7203	$52.67	179.1M	1.1M	19h 2m	520	2
53	GPT-5.6 Sol	0.7190	$154.11	169.8M	283k	6h 40m	688	13
54	Kimi K3	0.7151	$55.15	146.5M	497k	20h 0m	484	14
55	GPT-5.6 Sol	0.7125	$69.33	92.1M	185k	8h 7m	475	5
56	GLM-5.3 Flash	0.7029	$6.19	134.2M	441k	12h 1m	387	3
57	Kimi K3	0.6987	$79.07	224.2M	641k	20h 1m	556	12
58	GLM-5.3 Flash	0.6977	$3.78	63.8M	292k	10h 53m	273	5
59	GLM-5.3 Flash	0.6919	$5.75	129.8M	427k	15h 0m	361	4
60	Qwen3.8-Max-0902	0.6915	$35.54	115.2M	955k	20h 1m	444	1
61	GLM-5.3	0.6907	$44.40	135.6M	383k	15h 8m	392	12
62	Gemini 3.8 Flash	0.6886	$9.16	61.0M	246k	3h 25m	267	8
63	Grok 4.6	0.6883	$68.03	60.3M	544k	3h 28m	249	6
64	Qwen3.8-Max	0.6875	$16.94	52.6M	563k	18h 44m	340	2
65	Grok 4.7	0.6849	$35.29	35.5M	255k	1h 35m	157	10
66	Muse Spark 1.3	0.6821	$28.97	85.7M	430k	5h 33m	396	21
67	Muse Spark 1.3	0.6752	$165.04	162.2M	432k	18h 15m	706	25
68	Gemini 3.8 Flash	0.6750	$4.96	25.6M	195k	1h 47m	172	5
69	Grok 4.7	0.6735	$227.27	226.0M	738k	19h 38m	925	75
70	Grok 4.6	0.6689	$82.90	75.9M	477k	3h 6m	283	17
71	Gemini 3.7 Flash	0.6672	$3.04	15.3M	126k	1h 37m	140	1
72	Grok 4.6	0.6619	$46.47	48.9M	429k	4h 33m	274	7
73	Grok 4.7	0.6585	$21.77	22.6M	209k	1h 19m	122	7
74	Muse Spark 1.3	0.6538	$51.51	57.6M	507k	5h 41m	286	10
75	Gemini 3.7 Flash	0.6446	$3.44	16.9M	214k	2h 28m	151	2
76	Grok 4.7	0.6417	$24.01	24.2M	210k	1h 51m	131	4
77	Qwen3.8-Max-0902	0.6374	$51.28	174.8M	1.1M	20h 1m	568	2
78	GLM-5.3	0.6370	$18.59	55.0M	231k	19h 13m	287	3
79	Kimi K3	0.6270	$30.79	76.7M	394k	12h 20m	318	20
80	Kimi K3	0.6254	$97.66	258.3M	819k	19h 58m	576	17
81	Muse Spark 1.3	0.6245	$65.15	69.0M	497k	6h 34m	381	13
82	DeepSeek V4 Flash Vision Exp	0.6244	$2.53	133.2M	457k	10h 50m	402	7
83	Muse Spark 1.3	0.6205	$141.97	139.6M	348k	19h 5m	580	13
84	Gemini 3.8 Flash	0.6169	$10.88	84.0M	323k	4h 38m	300	2
85	Muse Spark 1.2	0.6114	$9.23	47.6M	407k	3h 16m	262	4
86	Gemini 3.7 Flash	0.6074	$16.26	72.9M	429k	6h 43m	280	5
87	GLM-5.3	0.6071	$32.20	106.0M	372k	12h 23m	375	5
88	Gemini 3.8 Flash	0.6021	$4.98	34.7M	202k	2h 25m	218	4
89	Muse Spark 1.2	0.5947	$9.36	45.3M	339k	3h 54m	244	2
90	Gemini 3.8 Flash	0.5930	$6.20	47.0M	194k	4h 21m	224	4
91	Grok 4.6	0.5924	$84.01	82.0M	496k	4h 20m	336	10
92	Muse Spark 1.2	0.5914	$9.21	41.8M	337k	3h 53m	230	2
93	Gemini 3.7 Flash	0.5912	$5.63	44.5M	188k	5h 26m	270	1
94	Muse Spark 1.2	0.5787	$10.64	52.8M	389k	2h 30m	272	8
95	Qwen3.8-Max	0.5728	$25.90	85.8M	648k	18h 2m	442	6
96	GLM-5.3 Flash	0.5673	$4.20	81.9M	369k	16h 1m	327	2
97	Muse Spark 1.2	0.5545	$7.70	42.7M	226k	2h 46m	257	5
98	DeepSeek V4 Flash Vision Exp	0.5485	$2.27	120.4M	400k	9h 24m	405	3
99	DeepSeek V4 Flash Vision Exp	0.4883	$3.26	177.3M	519k	9h 8m	426	7
100	DeepSeek V4 Flash Vision Exp	0.4768	$2.33	127.1M	362k	12h 24m	407	4
101	GLM-5.3 Flash	0.4693	$5.24	113.1M	401k	10h 10m	361	9
102	Qwen3.8-Max	0.4459	$25.19	78.5M	819k	19h 40m	374	2
103	DeepSeek V4 Flash Vision Exp	0.4348	$2.35	127.0M	382k	9h 0m	395	7
104	Inkling	0.4268	$4.27	4.3M	39k	1h 28m	101	2
105	Qwen3.8-Max	0.4074	$19.97	63.7M	596k	17h 56m	390	2
106	Qwen3.8-Max	0.2765	$43.05	138.5M	1.3M	20h 1m	512	1
107	Inkling	0.2712	$3.61	3.7M	31k	1h 49m	90	2
108	Inkling	0.2062	$7.66	7.9M	44k	1h 46m	158	2
109	Inkling	0.1413	$4.71	4.8M	39k	39m	98	2
110	Inkling	0.0057	$3.81	3.8M	60k	1h 38m	95	1