Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Astronomy Toolkit
task page →5 runs · indexed 2026-09-02| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | GPT-5.6 | 0.4849 | $43.38 | 52.6M | 186k | 3h 16m | 263 | 5 |
| 2 | GPT-5.6 | 0.1823 | $39.28 | 48.9M | 195k | 2h 7m | 255 | 4 |
| 3 | GPT-5.6 | 0.0000 | $29.74 | 37.3M | 170k | 2h 5m | 211 | 8 |
| 4 | GPT-5.6 | 0.0000 | $23.28 | 33.7M | 166k | 2h 33m | 207 | 5 |
| 5 | GPT-5.6 | 0.0000 | $47.11 | 54.0M | 192k | 2h 34m | 262 | 4 |