Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Verilog Simulator in Swift
task page →5 runs · indexed 2026-09-02| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | Grok 4.6 | 0.8253 | $223.65 | 211.2M | 1.9M | 12h 53m | 884 | 31 |
| 2 | Grok 4.6 | 0.8116 | $347.28 | 325.2M | 2.2M | 19h 55m | 1222 | 56 |
| 3 | Grok 4.6 | 0.7517 | $518.10 | 508.9M | 2.5M | 19h 53m | 1842 | 50 |
| 4 | Grok 4.6 | 0.6901 | $168.65 | 160.9M | 1.6M | 9h 35m | 691 | 25 |
| 5 | Grok 4.6 | 0.5188 | $107.03 | 99.0M | 943k | 6h 25m | 402 | 19 |