Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

PostgreSQL 18 on SQLite

task page →5 runs · indexed 2026-11-12
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 4 Hydrogen0.5879†$220.101284.8M4.5M19h 52m283038
2Gemini 4 Hydrogen0.5275†$227.621254.1M4.2M20h 1m272423
3Gemini 4 Hydrogen0.5220†$228.801259.6M4.4M19h 58m273152
4Gemini 4 Hydrogen0.4560†$200.541162.8M4.1M19h 59m258828
5Gemini 4 Hydrogen0.3297$220.801258.2M4.4M19h 34m273037

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.