Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Granite Mamba2 Inference Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1DeepSeek V4 Flash Vision Exp0.8708$2.68149.8M376k16h 23m4735
2DeepSeek V4 Flash Vision Exp0.7876$3.53195.8M540k19h 32m5198
3DeepSeek V4 Flash Vision Exp0.7578$8.78501.2M1.2M13h 5m11573
4DeepSeek V4 Flash Vision Exp0.7467$8.27472.9M1.1M11h 58m114023
5DeepSeek V4 Flash Vision Exp0.4680$3.00159.1M520k6h 30m4425