Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Grok 4.70.2867$182.37175.0M483k20h 0m74415
2Grok 4.70.2033$279.55260.9M639k20h 0m94917
3Grok 4.70.0119$55.6143.7M222k7h 51m1957
4Grok 4.70.0000$308.24304.6M520k20h 0m12151
5Grok 4.70.0000$72.6566.7M251k9h 7m2659