Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Synthetic Music Diarization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1GPT-5.60.5247$44.1953.3M154k7h 34m2673
2GPT-5.60.5065$80.6578.5M178k15h 57m33911
3GPT-5.60.4952$59.6269.7M147k15h 37m3593
4GPT-5.60.4737$78.7876.5M133k14h 47m2864
5GPT-5.60.4727$68.5982.8M153k14h 29m4257