Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-11-12
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Fable 5.20.3709$52.44112.4M486k18h 31m2889
2Claude Fable 5.20.3657$52.74108.5M513k17h 32m27211
3Claude Fable 5.20.3584$47.2389.6M475k16h 51m2508
4Claude Fable 5.20.3582$64.80134.7M624k17h 6m2859
5Claude Fable 5.20.2610$53.90114.8M495k17h 28m2728