Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

MEG Speech Decoding

task page →5 runs · indexed 2026-10-08
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Haiku 5.50.3592$3.5753.4M356k17h 25m2051
2Claude Haiku 5.50.3589$6.1699.7M434k15h 47m3121
3Claude Haiku 5.50.3229$5.5286.2M451k9h 19m2653
4Claude Haiku 5.50.2649$5.0078.8M385k13h 42m2501
5Claude Haiku 5.50.2545$5.8188.4M483k16h 59m2516