Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 3.7 Flash0.0169$19.15195.9M289k3h 33m5054
2Gemini 3.7 Flash0.0000$9.47100.2M149k1h 43m3164
3Gemini 3.7 Flash0.0000$9.0285.7M143k1h 52m3061
4Gemini 3.7 Flash0.0000$12.5890.8M182k4h 36m3171
5Gemini 3.7 Flash0.0000$6.5851.9M91k1h 41m2964