Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

libexpat Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1DeepSeek V4 Flash Vision Exp0.0891$17.041034.3M1.6M6h 42m22736
2DeepSeek V4 Flash Vision Exp0.0545$16.46992.0M1.7M6h 43m222211
3DeepSeek V4 Flash Vision Exp0.0000$13.51827.8M1.3M5h 43m172013
4DeepSeek V4 Flash Vision Exp0.0000$21.931323.6M2.2M8h 50m30957
5DeepSeek V4 Flash Vision Exp0.0000$33.361965.0M3.8M19h 31m410248