Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 3.8 Flash0.0190$30.46330.6M252k3h 24m70911
2Gemini 3.8 Flash0.0058$23.48261.8M192k2h 8m5634
3Gemini 3.8 Flash0.0021$39.53434.9M429k7h 2m111913
4Gemini 3.8 Flash0.0000$24.27258.5M198k4h 49m6073
5Gemini 3.8 Flash0.0000$21.47225.2M181k2h 13m5715