Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Verilog Simulator in Swift
task page →5 runs · indexed 2026-09-22| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | Grok 4.7 | 0.8853 | $200.79 | 205.0M | 994k | 5h 44m | 853 | 1 |
| 2 | Grok 4.7 | 0.8784 | $244.06 | 246.8M | 1.1M | 15h 21m | 1005 | 27 |
| 3 | Grok 4.7 | 0.8596 | $839.06 | 861.8M | 2.3M | 19h 58m | 3507 | 37 |
| 4 | Grok 4.7 | 0.8510 | $180.74 | 176.1M | 878k | 5h 58m | 658 | 4 |
| 5 | Grok 4.7 | 0.8476 | $334.11 | 341.6M | 1.2M | 11h 19m | 1457 | 47 |