Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 3.8 Flash0.0000$90.95821.2M1.4M20h 0m20381
2Gemini 3.8 Flash0.0000$69.03618.4M870k14h 14m14773
3Gemini 3.8 Flash0.0000$77.67724.4M1.0M15h 44m16762
4Gemini 3.8 Flash0.0000$82.03739.4M1.1M17h 33m17971
5Gemini 3.8 Flash0.0000$66.46629.7M880k14h 44m15993