Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

MEG Speech Decoding

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1GPT-6 Astra0.3919$899.22430.4M993k17h 31m106415
2GPT-6 Astra0.3729$274.60132.9M344k8h 16m41113
3GPT-6 Astra0.3704$154.2876.5M270k4h 15m2979
4GPT-6 Astra0.3557$452.78217.0M444k15h 46m52714
5GPT-6 Astra0.3431$526.36253.0M673k17h 55m69420