Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Fable 51.0000$203.81160.6M603k9h 37m33511
2Claude Fable 51.0000$201.80156.2M629k7h 5m31912
3Claude Fable 50.9841$232.48180.5M725k7h 59m3138
4Claude Fable 50.0000$288.50223.6M888k18h 15m53613
5Claude Fable 50.0000$144.73104.4M563k6h 16m23513