Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1DeepSeek V4 Flash Vision Exp0.1123$1.1252.3M255k18h 23m2562
2DeepSeek V4 Flash Vision Exp0.0770$1.2263.5M222k19h 1m3342
3DeepSeek V4 Flash Vision Exp0.0348$1.4475.8M242k19h 19m3492
4DeepSeek V4 Flash Vision Exp0.0000$1.5179.4M262k19h 14m4062
5DeepSeek V4 Flash Vision Exp0.0000$1.3365.8M275k19h 51m3131