Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
SPICE Circuit Simulator in Rust
task page →5 runs · indexed 2026-09-02| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | Grok 4.6 | 0.5657 | $717.25 | 714.4M | 2.7M | 18h 22m | 2483 | 266 |
| 2 | Grok 4.6 | 0.5253 | $835.65 | 836.5M | 3.1M | 20h 0m | 3128 | 205 |
| 3 | Grok 4.6 | 0.4848 | $586.10 | 582.0M | 3.0M | 17h 34m | 2322 | 89 |
| 4 | Grok 4.6 | 0.4646 | $1191.20 | 1187.2M | 2.5M | 19h 58m | 3879 | 96 |
| 5 | Grok 4.6 | 0.4545 | $165.93 | 154.1M | 860k | 5h 37m | 563 | 37 |