Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Verilog Simulator in Swift

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1DeepSeek V4 Flash Vision Exp0.5582$23.111453.0M1.8M19h 40m31183
2DeepSeek V4 Flash Vision Exp0.4212$16.08998.7M1.4M20h 0m21284
3DeepSeek V4 Flash Vision Exp0.3784$22.061380.9M1.8M19h 50m299912
4DeepSeek V4 Flash Vision Exp0.3253$27.961735.1M2.4M17h 46m379822
5DeepSeek V4 Flash Vision Exp0.3065$23.641484.7M1.9M18h 25m315730