Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Lean 4 Kernel Type Checker in Pascal
task page →5 runs · indexed 2026-09-02| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | Grok 4.6 | 0.3824 | $105.13 | 105.0M | 1.0M | 6h 34m | 490 | 2 |
| 2 | Grok 4.6 | 0.0000 | $114.14 | 110.5M | 1.1M | 7h 47m | 492 | 4 |
| 3 | Grok 4.6 | 0.0000 | $407.54 | 406.7M | 2.0M | 19h 47m | 1527 | 137 |
| 4 | Grok 4.6 | 0.0000 | $250.10 | 240.1M | 1.8M | 13h 13m | 970 | 43 |
| 5 | Grok 4.6 | 0.0000 | $233.84 | 217.8M | 2.5M | 19h 53m | 929 | 30 |