Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-10-08
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Haiku 5.51.0000$12.16186.9M1.0M4h 28m4234
2Claude Haiku 5.51.0000$12.93195.5M1.2M5h 31m4595
3Claude Haiku 5.50.9841$12.26189.0M1.0M5h 12m4672
4Claude Haiku 5.50.9841$9.10133.0M903k3h 32m3702
5Claude Haiku 5.50.9841$10.51161.8M906k4h 31m3892