Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Lean 4 Kernel Type Checker in Pascal
task page →5 runs · indexed 2026-09-02| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | Kimi K3 | 0.9198 | $192.68 | 537.9M | 1.4M | 20h 0m | 1218 | 1 |
| 2 | Kimi K3 | 0.8313 | $155.97 | 405.9M | 1.5M | 19h 47m | 935 | 3 |
| 3 | Kimi K3 | 0.5265 | $147.65 | 387.7M | 1.4M | 20h 2m | 894 | 1 |
| 4 | Kimi K3 | 0.4229 | $171.33 | 477.1M | 1.3M | 19h 55m | 1130 | 12 |
| 5 | Kimi K3 | 0.2644 | $151.43 | 423.8M | 1.1M | 20h 1m | 928 | 1 |