Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Opus 5.50.3908$28.0787.7M400k17h 51m28612
2Claude Opus 5.50.2824$26.9882.6M395k14h 4m2826
3Claude Opus 5.50.2715$26.8783.2M387k12h 26m2818
4Claude Opus 5.50.2621$24.2868.6M403k13h 10m2304
5Claude Opus 5.50.1731$23.2867.5M372k18h 2m2387