Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

MEG Speech Decoding

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Opus 50.3591$41.2557.4M336k16h 38m24411
2Claude Opus 50.3182$39.6657.3M295k17h 37m2583
3Claude Opus 50.3001$47.8268.3M371k18h 4m25114
4Claude Opus 50.1306$32.6545.8M261k17h 4m2329
5Claude Opus 50.0000$41.1859.8M304k17h 59m2679