Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1DeepSeek V4 Flash Vision Exp0.3599$12.71725.7M1.6M10h 38m16144
2DeepSeek V4 Flash Vision Exp0.3164$9.48551.4M1.2M7h 58m12288
3DeepSeek V4 Flash Vision Exp0.2513$13.44768.2M1.8M13h 43m17607
4DeepSeek V4 Flash Vision Exp0.0143$12.56761.2M1.2M12h 33m162735
5DeepSeek V4 Flash Vision Exp0.0000$11.64694.6M1.3M11h 22m141333