Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-10-08
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Haiku 5.50.1858$3.9658.4M400k17h 26m2172
2Claude Haiku 5.50.1698$7.09114.6M506k14h 15m3253
3Claude Haiku 5.50.1416$5.3082.3M440k13h 57m2561
4Claude Haiku 5.50.1133$4.7675.7M379k15h 43m2631
5Claude Haiku 5.50.1082$4.3564.8M433k15h 17m2312