Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-11-12
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 4 Hydrogen1.0000$17.4576.7M436k1h 23m1561
2Gemini 4 Hydrogen1.0000$20.65117.8M529k1h 28m2471
3Gemini 4 Hydrogen1.0000$13.6858.8M410k1h 12m1531
4Gemini 4 Hydrogen0.9984$14.7449.6M443k1h 39m1381
5Gemini 4 Hydrogen0.9807$14.7364.1M471k1h 34m1502