Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

SPICE Circuit Simulator in Rust

task page →5 runs · indexed 2026-09-22
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Gemini 3.8 Flash0.5354$35.82384.7M639k3h 11m9654
2Gemini 3.8 Flash0.4242$24.11264.9M400k1h 50m6102
3Gemini 3.8 Flash0.3232$15.32160.0M291k1h 17m4263
4Gemini 3.8 Flash0.0808$2.1615.8M108k23m1421
5Gemini 3.8 Flash0.0101†$2.2617.9M93k20m1402

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.