Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 3.7 Flash0.9448$95.08678.0M1.4M19h 49m16601
2Gemini 3.7 Flash0.9361$54.83453.2M1.3M12h 43m12241
3Gemini 3.7 Flash0.1248$74.81557.5M1.1M14h 22m12171
4Gemini 3.7 Flash0.0087$48.94384.1M939k13h 20m11181
5Gemini 3.7 Flash0.0000$101.50861.0M1.8M19h 58m20921