Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-11-12
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 4 Carbon0.3306$63.61105.5M508k19h 32m28112
2Gemini 4 Carbon0.3267$52.49116.9M551k18h 23m30816
3Gemini 4 Carbon0.3033$84.93125.2M506k19h 32m32813
4Gemini 4 Carbon0.2918$89.02127.5M481k19h 9m3036
5Gemini 4 Carbon0.2476$50.6946.6M317k19h 55m1705