Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-10-08
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Qwen3.8-Max-09020.1653$45.5698.3M3.3M20h 1m2941
2Qwen3.8-Max-09020.0111$40.0677.6M3.2M20h 1m2441
3Qwen3.8-Max-09020.0000$35.7344.7M3.0M20h 1m3121
4Qwen3.8-Max-09020.0000$33.4345.6M3.5M20h 1m1841
5Qwen3.8-Max-09020.0000$22.2825.4M2.5M14h 13m1511