Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Cranelift Codegen Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1DeepSeek V4 Flash Vision Exp0.0237$8.27504.6M723k9h 18m126011
2DeepSeek V4 Flash Vision Exp0.0107$5.01303.8M439k7h 50m7238
3DeepSeek V4 Flash Vision Exp0.0030$5.08311.7M419k8h 3m7816
4DeepSeek V4 Flash Vision Exp0.0000$3.68220.8M344k8h 44m6708
5DeepSeek V4 Flash Vision Exp0.0000$4.87296.6M422k6h 43m7303