Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Astronomy Toolkit

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Grok 4.60.5299$15.5715.6M323k1h 52m1064
2Grok 4.60.3993$48.1146.2M395k3h 31m2086
3Grok 4.60.2000$34.6834.5M354k2h 42m1758
4Grok 4.60.1971$39.6635.3M400k3h 43m16511
5Grok 4.60.0000$23.0923.9M317k4h 4m1523