Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Qwen3.8-Max0.0000$14.1428.2M1.1M19h 59m1691
2Qwen3.8-Max0.0000$8.3110.6M914k19h 59m1092
3Qwen3.8-Max0.0000$13.9225.5M1.2M19h 56m1672
4Qwen3.8-Max0.0000$19.6845.8M1.3M20h 0m2111
5Qwen3.8-Max0.0000$10.3513.6M1.1M19h 57m1151