Traces
Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
Astronomy Toolkit
task page →5 runs · indexed 2026-09-02| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|
| 1 | Kimi K3 | 0.6250 | $60.98 | 152.4M | 478k | 16h 31m | 414 | 12 |
| 2 | Kimi K3 | 0.3983 | $90.41 | 238.0M | 505k | 20h 1m | 587 | 20 |
| 3 | Kimi K3 | 0.3959 | $20.08 | 46.3M | 279k | 6h 2m | 205 | 5 |
| 4 | Kimi K3 | 0.3804 | $70.49 | 167.8M | 452k | 19h 35m | 468 | 8 |
| 5 | Kimi K3 | 0.2995 | $53.30 | 137.6M | 418k | 11h 54m | 430 | 7 |