Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Higgs Uncertainty Inference

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	1.0000	$164.97	80.6M	296k	2h 47m	306	8
2	Claude Opus 5	1.0000	$43.00	55.4M	421k	5h 4m	193	4
3	Claude Opus 5.5	1.0000	$25.57	70.3M	442k	6h 17m	211	11
4	Claude Opus 5	1.0000	$43.73	58.4M	394k	12h 22m	210	6
5	GPT-6 Astra	1.0000	$50.75	31.1M	211k	1h 50m	184	6
6	Claude Fable 5.1	0.9930	$40.59	65.5M	322k	8h 40m	241	9
7	Claude Opus 5.5	0.9897	$30.03	90.4M	459k	7h 8m	258	13
8	Claude Sonnet 5.5	0.9897	$29.45	110.7M	573k	6h 41m	259	4
9	Claude Fable 5.1	0.9895	$33.56	52.1M	309k	8h 2m	221	8
10	Qwen3.8-Max	0.9778	$23.74	79.2M	556k	12h 13m	428	14
11	GPT-6 Astra	0.9768	$52.93	33.2M	214k	1h 55m	200	5
12	DeepSeek V4 Flash Vision Exp	0.9597	$1.51	70.8M	347k	3h 23m	283	4
13	Claude Sonnet 5.5	0.9593	$30.61	116.2M	578k	14h 56m	275	2
14	Kimi K3	0.9593	$29.55	62.1M	341k	12h 49m	285	15
15	Claude Fable 5	0.9397	$59.14	36.3M	315k	5h 54m	162	8
16	Claude Fable 5	0.9375	$84.70	58.1M	370k	13h 38m	228	14
17	Claude Opus 5.5	0.9370	$28.53	84.2M	453k	7h 52m	260	12
18	Qwen3.8-Max-0902	0.9183	$45.24	139.4M	1.5M	19h 44m	428	1
19	Grok 4.6	0.9143	$37.23	34.8M	407k	3h 22m	158	10
20	Muse Spark 1.2	0.9041	$8.87	38.4M	436k	2h 57m	150	1
21	Grok 4.6	0.8991	$42.77	39.2M	529k	3h 38m	183	9
22	Claude Sonnet 5.5	0.8984	$37.57	147.8M	629k	11h 9m	314	4
23	Claude Haiku 5.5	0.8970	$5.84	85.5M	559k	11h 56m	222	2
24	Grok 4.6	0.8827	$39.92	37.7M	462k	3h 38m	181	8
25	Inkling	0.8760	$6.24	6.3M	65k	37m	140	1
26	Claude Haiku 5.5	0.8579	$4.65	65.6M	502k	5h 43m	188	2
27	Muse Spark 1.3	0.8206	$37.73	59.2M	320k	3h 38m	300	12
28	Grok 4.6	0.8188	$274.70	264.2M	1.9M	19h 38m	1078	67
29	GPT-5.6 Sol	0.7863	$99.90	97.4M	228k	4h 26m	327	20
30	Grok 4.7	0.7706	$11.93	13.0M	204k	1h 11m	90	5
31	Qwen3.8-Max	0.7685	$16.66	51.1M	571k	13h 28m	342	5
32	Muse Spark 1.3	0.7474	$18.67	43.3M	220k	4h 23m	250	6
33	DeepSeek V4 Flash Vision Exp	0.7308	$2.17	110.7M	423k	3h 32m	374	9
34	Muse Spark 1.2	0.7187	$4.40	15.5M	216k	1h 29m	110	2
35	Muse Spark 1.2	0.7132	$3.96	18.1M	225k	49m	126	4
36	Qwen3.8-Max-0902	0.5260	$31.31	94.3M	1.1M	19h 31m	341	1
37	Claude Sonnet 5.5	0.4600	$33.95	128.3M	649k	6h 32m	272	3
38	Gemini 3.8 Flash	0.4507	$3.63	26.5M	187k	49m	177	3
39	Claude Opus 5	0.4324	$63.20	91.3M	476k	9h 29m	267	11
40	GPT-6 Astra	0.4310	$132.03	68.3M	275k	2h 40m	289	5
41	Qwen3.8-Max	0.4289	$16.21	49.4M	555k	8h 58m	285	8
42	Kimi K3	0.4200	$32.18	58.0M	281k	15h 50m	280	8
43	Claude Opus 5	0.3824	$73.86	111.1M	500k	10h 52m	316	11
44	Muse Spark 1.3	0.3726	$625.66	665.8M	679k	19h 55m	1128	223
45	Muse Spark 1.3	0.3641	$40.72	52.7M	332k	3h 49m	257	8
46	Qwen3.8-Max	0.3449	$15.61	47.3M	543k	7h 37m	278	8
47	Gemini 4 Argon	0.3435	$96.85	59.0M	525k	6h 34m	155	2
48	Qwen3.8-Max-0902	0.3378	$32.65	97.4M	1.2M	19h 38m	376	1
49	Claude Fable 5.1	0.3345	$30.45	45.8M	311k	4h 14m	174	15
50	Gemini 3.8 Flash	0.3266	$3.89	26.2M	153k	53m	177	3
51	Gemini 4 Argon	0.3199	$35.62	42.7M	359k	5h 46m	155	3
52	Qwen3.8-Max	0.3078	$18.56	57.9M	578k	8h 28m	322	6
53	Claude Opus 5	0.3011	$69.90	100.7M	538k	8h 25m	268	5
54	Claude Opus 5.5	0.2834	$29.08	88.4M	439k	9h 41m	265	10
55	Claude Opus 5.5	0.2805	$36.69	117.7M	504k	7h 47m	310	12
56	Claude Sonnet 5.5	0.2521	$37.68	144.7M	683k	9h 35m	297	3
57	Claude Fable 5	0.2381	$63.35	41.3M	309k	8h 51m	197	11
58	Gemini 4 Argon	0.2379	$42.74	116.3M	781k	7h 14m	281	4
59	Claude Fable 5	0.2345	$86.58	63.1M	319k	16h 11m	264	7
60	Gemini 3.8 Flash	0.2264	$4.42	36.8M	191k	1h 14m	202	5
61	Claude Haiku 5.5	0.2175	$5.41	75.1M	593k	4h 10m	203	2
62	Gemini 4 Argon	0.2135	$100.44	83.2M	842k	7h 14m	239	4
63	Grok 4.6	0.2104	$116.88	112.5M	824k	9h 43m	470	52
64	GPT-5.6 Sol	0.2084	$52.26	56.6M	152k	2h 42m	244	5
65	GPT-6 Astra	0.2020	$84.84	43.9M	239k	1h 53m	208	6
66	Claude Fable 5.1	0.2017	$30.51	47.2M	284k	6h 48m	194	9
67	Qwen3.8-Max-0902	0.1773	$37.51	112.2M	1.0M	19h 48m	461	6
68	Gemini 3.7 Flash	0.1681	$1.72	9.3M	135k	1h 3m	102	1
69	Claude Fable 5	0.1639	$81.13	55.6M	354k	15h 53m	224	11
70	GLM-5.3	0.1632	$24.11	84.1M	350k	8h 48m	310	8
71	Muse Spark 1.2	0.1494	$13.10	65.0M	597k	2h 52m	267	1
72	Claude Haiku 5.5	0.1334	$4.56	63.7M	502k	4h 40m	187	2
73	Gemini 3.7 Flash	0.1295	$1.98	10.2M	141k	50m	105	3
74	Gemini 4 Argon	0.1190	$36.03	53.9M	536k	3h 17m	162	3
75	Gemini 3.7 Flash	0.1075	$1.62	9.2M	146k	1h 7m	102	1
76	Claude Haiku 5.5	0.1032	$5.88	83.3M	608k	3h 20m	216	1
77	GLM-5.3	0.1005	$24.46	71.1M	367k	17h 31m	283	7
78	Kimi K3	0.0960	$32.35	77.4M	380k	13h 56m	311	15
79	Qwen3.8-Max-0902	0.0834	$33.12	98.6M	1.2M	19h 40m	371	1
80	Gemini 3.7 Flash	0.0798	$2.53	10.3M	161k	1h 26m	110	1
81	Claude Fable 5.1	0.0778	$29.88	44.4M	316k	2h 48m	183	13
82	GPT-5.6 Sol	0.0777	$44.33	50.5M	161k	1h 56m	229	6
83	DeepSeek V4 Flash Vision Exp	0.0718	$2.02	102.8M	397k	15h 29m	346	4
84	DeepSeek V4 Flash Vision Exp	0.0700	$1.50	70.3M	352k	6h 13m	290	6
85	Gemini 3.7 Flash	0.0647	$3.79	20.7M	194k	1h 41m	139	2
86	Kimi K3	0.0626	$34.08	68.6M	372k	14h 20m	275	12
87	DeepSeek V4 Flash Vision Exp	0.0559	$1.32	62.9M	305k	6h 32m	278	4
88	GLM-5.3	0.0517	$9.91	30.6M	263k	2h 10m	167	5
89	Muse Spark 1.2	0.0498	$2.47	8.0M	164k	1h 0m	83	2
90	GLM-5.3	0.0375	$14.94	49.5M	308k	3h 28m	223	2
91	Gemini 3.8 Flash	0.0340	$3.04	20.0M	136k	40m	164	4
92	Muse Spark 1.3	0.0300	$39.32	51.4M	265k	3h 54m	261	8
93	Kimi K3	0.0289	$90.08	230.0M	659k	20h 0m	555	1
94	GLM-5.3	0.0251	$17.68	60.0M	356k	3h 29m	246	3
95	GPT-5.6 Sol	0.0080	$56.44	60.4M	164k	6h 2m	259	12
96	Inkling	0.0078	$3.62	3.6M	51k	2h 38m	120	1
97	Gemini 3.8 Flash	0.0073	$2.13	14.4M	132k	40m	136	2
98	GPT-5.6 Sol	0.0049	$70.63	65.2M	124k	2h 29m	194	6
99	Inkling	0.0004	$3.37	3.3M	54k	1h 37m	104	1
100	Inkling	0.0004	$4.08	4.1M	54k	1h 12m	112	2
101	Grok 4.7	0.0000	$420.44	408.4M	739k	19h 20m	1293	18
102	Grok 4.7	0.0000	$7.84	8.3M	179k	58m	63	3
103	Inkling	0.0000	$2.47	2.5M	36k	1h 12m	106	1
104	GLM-5.3 Flash	0.0000	$3.36	53.3M	330k	10h 44m	230	6
105	GLM-5.3 Flash	0.0000	$3.57	84.9M	393k	10h 21m	284	2
106	Grok 4.7	0.0000	$17.21	17.6M	220k	1h 13m	99	5
107	GLM-5.3 Flash	0.0000	$2.05	35.6M	271k	7h 4m	202	3
108	Grok 4.7	0.0000	$9.29	10.1M	177k	1h 2m	76	2
109	GLM-5.3 Flash	0.0000	$1.70	38.2M	299k	3h 32m	183	4
110	GLM-5.3 Flash	0.0000	$4.90	95.4M	391k	15h 5m	312	7