Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Fable 50.0442$246.50205.1M519k8h 17m48110
2Claude Fable 50.0000$202.86169.0M429k14h 47m43614
3Claude Fable 50.0000$289.82249.1M515k7h 2m54312
4Claude Fable 50.0000$175.12145.0M372k12h 9m42714
5Claude Fable 50.0000$186.99154.4M396k7h 35m4299