Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Grok 4.60.0322$488.14454.2M2.3M19h 33m170383
2Grok 4.60.0025$162.38158.0M937k10h 27m64914
3Grok 4.60.0012$313.02296.5M1.9M18h 41m112019
4Grok 4.60.0007$96.0091.3M481k3h 53m3293
5Grok 4.60.0000$419.76405.9M2.2M19h 4m158660