Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Cranelift Codegen Optimization

task page →4 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1GPT-6 Astra0.3006$2589.931231.7M1.9M19h 38m2587122
2GPT-6 Astra0.2357$2732.071287.7M2.4M19h 34m282997
3GPT-6 Astra0.2194$2585.691232.6M2.0M18h 22m264379
4GPT-6 Astra0.1650$2812.601334.7M2.3M19h 56m293492