Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.2557	$99.14	98.0M	624k	19h 20m	424	18
2	Grok 4.6	0.1957	$53.90	66.7M	503k	19h 24m	395	24
3	Grok 4.6	0.1570	$59.53	57.5M	295k	19h 26m	258	11
4	Grok 4.6	0.1368	$54.49	49.3M	462k	19h 16m	240	10
5	Grok 4.6	0.0839	$80.45	75.7M	333k	19h 42m	279	3