Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Fable 5.11.0000$34.1749.9M378k2h 37m1646
2Claude Fable 5.11.0000$45.3070.2M418k4h 0m2009
3Claude Fable 5.11.0000$34.2250.9M360k1h 59m1598
4Claude Fable 5.11.0000$43.0867.7M379k4h 3m20611
5Claude Fable 5.11.0000$50.9183.1M385k3h 9m2328