Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Opus 51.0000$174.84280.2M919k15h 16m71420
2Claude Opus 51.0000$204.51327.4M1.1M13h 23m74619
3Claude Opus 50.9984$103.75161.1M640k5h 43m3154
4Claude Opus 50.9841$206.83330.5M1.1M10h 19m76112
5Claude Opus 50.9635$169.99269.9M940k17h 12m65517