Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Notebook Compression

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Opus 50.5259$112.64181.6M606k17h 57m45417
2Claude Opus 50.4532$73.01109.0M516k14h 40m35212
3Claude Opus 50.4439$118.20194.6M584k18h 55m50714
4Claude Opus 50.4351$112.61183.8M577k18h 34m47119
5Claude Opus 50.4296$84.72133.1M506k18h 0m38312