Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Opus 50.2499$36.8448.8M334k17h 28m2032
2Claude Opus 50.1760$28.5236.5M275k16h 52m1823
3Claude Opus 50.1714$43.9457.7M410k17h 5m2004
4Claude Opus 50.1316$29.9237.9M299k16h 54m1792
5Claude Opus 50.0000$34.4342.6M358k17h 38m1733