Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Astronomy Toolkit
task page →5 runs · indexed 2026-09-22| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | Grok 4.7 | 0.3076 | $28.45 | 28.6M | 218k | 1h 15m | 142 | 5 |
| 2 | Grok 4.7 | 0.2999 | $23.31 | 23.1M | 224k | 1h 29m | 118 | 3 |
| 3 | Grok 4.7 | 0.0108 | $18.18 | 18.2M | 206k | 1h 1m | 105 | 3 |
| 4 | Grok 4.7 | 0.0075 | $224.04 | 218.5M | 550k | 3h 42m | 699 | 15 |
| 5 | Grok 4.7 | 0.0032 | $13.33 | 14.3M | 178k | 52m | 90 | 2 |