Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Fable 5.10.2272$15.4522.4M175k11h 13m1645
2Claude Fable 5.10.1750$17.1526.3M165k12h 46m1826
3Claude Fable 5.10.1459$14.9022.4M152k15h 9m1714
4Claude Fable 5.10.1343$11.0815.3M141k13h 28m1343
5Claude Fable 5.10.0226$15.7421.7M202k14h 5m1414