Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1GPT-6 Astra0.9807$122.0864.3M290k2h 50m2824
2GPT-6 Astra0.9807$62.9837.7M245k1h 38m2035
3GPT-6 Astra0.9807$123.0561.8M300k2h 8m2603
4GPT-6 Astra0.9791$34.1522.2M179k1h 14m1333
5GPT-6 Astra0.9791$174.6285.4M285k2h 50m3114