Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Synthetic Music Diarization

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Opus 50.5368$28.6338.3M258k18h 34m2028
2Claude Opus 50.5328$33.9547.5M267k18h 38m2177
3Claude Opus 50.5241$22.9629.3M223k18h 54m1755
4Claude Opus 50.4833$26.8234.5M255k17h 35m1813
5Claude Opus 50.2240$27.3835.8M258k19h 9m1869