Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Opus 5.51.0000$41.28133.2M560k3h 31m26313
2Claude Opus 5.51.0000$71.71241.5M889k6h 55m57321
3Claude Opus 5.51.0000$35.94109.8M528k2h 59m2328
4Claude Opus 5.51.0000$31.1188.5M510k2h 27m2024
5Claude Opus 5.51.0000$37.66116.3M544k3h 20m2438