Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Lean 4 Kernel Type Checker in Pascal
task page →5 runs · indexed 2026-09-22| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | Grok 4.7 | 0.9589 | $192.69 | 192.9M | 802k | 7h 19m | 790 | 8 |
| 2 | Grok 4.7 | 0.9461 | $478.73 | 472.8M | 1.7M | 19h 19m | 1887 | 5 |
| 3 | Grok 4.7 | 0.9103 | $351.92 | 346.3M | 1.1M | 20h 0m | 1425 | 6 |
| 4 | Grok 4.7 | 0.8682 | $294.16 | 294.8M | 1.1M | 13h 7m | 1229 | 6 |
| 5 | Grok 4.7 | 0.0000 | $418.16 | 407.2M | 1.6M | 18h 42m | 1640 | 7 |