Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Verilog Simulator in Swift

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1GPT-6 Astra0.9503$104.5349.0M213k1h 48m1875
2GPT-6 Astra0.9469$329.41155.6M366k2h 26m40926
3GPT-6 Astra0.9452$47.7326.0M162k1h 5m1303
4GPT-6 Astra0.9349$94.8544.6M216k1h 33m1746
5GPT-6 Astra0.9264$71.9536.3M192k1h 35m1626