Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-10-08
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Sonnet 5.50.3328$24.9296.2M443k18h 17m3132
2Claude Sonnet 5.50.2671$40.11160.9M619k15h 53m3563
3Claude Sonnet 5.50.2578$28.93110.0M545k14h 19m2822
4Claude Sonnet 5.50.2467$39.74163.6M545k19h 1m3913
5Claude Sonnet 5.50.2147$34.56138.5M535k18h 9m3652