Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Fable 50.2478$59.8943.2M223k15h 59m22910
2Claude Fable 50.1170$54.5837.6M230k16h 38m2145
3Claude Fable 50.0927$57.4840.3M232k16h 57m2104
4Claude Fable 50.0728$58.6940.0M246k15h 56m2039
5Claude Fable 50.0619$49.5134.2M205k16h 37m1993