Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-11-12
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 4 Carbon1.0000$16.7653.0M382k2h 4m1332
2Gemini 4 Carbon1.0000$10.6338.3M340k1h 46m1292
3Gemini 4 Carbon1.0000$20.8262.2M414k2h 55m1572
4Gemini 4 Carbon1.0000$24.9159.3M417k3h 35m1612
5Gemini 4 Carbon0.9791$17.6137.8M349k2h 1m1182