Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Opus 50.0249$124.87207.2M534k12h 23m4607
2Claude Opus 50.0223$101.43161.0M523k12h 35m3908
3Claude Opus 50.0048$110.39179.3M515k12h 40m4317
4Claude Opus 50.0000$89.33141.7M467k15h 55m37611
5Claude Opus 50.0000$158.96248.3M890k16h 5m69315