Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

libexpat Optimization

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Grok 4.70.3527$861.01886.1M3.3M19h 22m3633135
2Grok 4.70.1576$386.43383.9M880k5h 16m127713
3Grok 4.70.0000$77.7179.6M493k2h 16m3254
4Grok 4.70.0000$35.6933.2M254k1h 17m1395
5Grok 4.70.0000†$83.0379.6M516k2h 36m31413

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.