Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Verilog Simulator in Swift
task page →5 runs · indexed 2026-09-02| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | GPT-5.6 | 0.8853 | $427.16 | 420.2M | 394k | 14h 37m | 921 | 9 |
| 2 | GPT-5.6 | 0.8596 | $271.89 | 260.9M | 315k | 4h 56m | 650 | 5 |
| 3 | GPT-5.6 | 0.8493 | $335.11 | 326.9M | 349k | 4h 23m | 746 | 9 |
| 4 | GPT-5.6 | 0.8339 | $184.09 | 180.1M | 273k | 4h 24m | 480 | 6 |
| 5 | GPT-5.6 | 0.8236 | $181.11 | 176.3M | 277k | 4h 52m | 476 | 3 |