Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

MEG Speech Decoding

task page →5 runs · indexed 2026-11-12
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 4 Hydrogen0.3945$53.86133.8M469k17h 8m2812
2Gemini 4 Hydrogen0.3206$58.02128.9M451k18h 17m3119
3Gemini 4 Hydrogen0.2520$53.50111.1M470k18h 54m2691
4Gemini 4 Hydrogen0.2404$50.6179.9M446k18h 43m2252
5Gemini 4 Hydrogen0.1470$34.87135.0M430k14h 17m2952