Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Astronomy Toolkit

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1GPT-6 Astra0.8045$135.6567.7M278k2h 40m2775
2GPT-6 Astra0.7969$2365.471121.6M2.3M19h 43m254849
3GPT-6 Astra0.7058$233.15111.6M353k2h 41m35610
4GPT-6 Astra0.7013$86.8245.8M224k2h 2m2145
5GPT-6 Astra0.6917$365.75173.3M402k3h 17m4577