Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

SGLang Inference System Optimization

task page →5 runs · indexed 2026-10-08
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Haiku 5.50.1173$15.92254.5M1.2M10h 40m6252
2Claude Haiku 5.50.0000$14.49235.4M958k9h 43m5943
3Claude Haiku 5.50.0000$14.92236.6M1.1M7h 37m5972
4Claude Haiku 5.50.0000$13.92215.0M1.1M9h 1m5133
5Claude Haiku 5.50.0000$24.57393.7M1.7M13h 34m9056