Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1GPT-6 Astra0.3513$198.61101.4M290k17h 55m3815
2GPT-6 Astra0.1940$334.17159.8M312k18h 23m4127
3GPT-6 Astra0.1777$89.9548.3M203k19h 38m24410
4GPT-6 Astra0.0929$278.29132.5M303k16h 52m3787
5GPT-6 Astra0.0523$53.3535.6M191k19h 46m2186