Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Multi-GPU Efficient Finetuning

task page →5 runs · indexed 2026-10-08
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Claude Haiku 5.50.2857$3.4948.9M402k16h 53m1633
2Claude Haiku 5.50.2619$1.7824.5M255k17h 19m1352
3Claude Haiku 5.50.2143$2.4634.8M304k17h 30m1583
4Claude Haiku 5.50.1905$3.2445.3M385k19h 9m1571
5Claude Haiku 5.50.0714$4.8271.2M466k18h 3m2191