Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Optimizer Design

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-5.6	0.3487	$65.53	80.8M	133k	10h 22m	433	4
2	GPT-5.6	0.3194	$196.66	203.2M	202k	11h 49m	678	23
3	GPT-5.6	0.2846	$55.29	72.7M	133k	15h 42m	423	5
4	GPT-5.6	0.2809	$71.65	93.2M	177k	14h 22m	523	21
5	GPT-5.6	0.2234	$31.29	52.9M	100k	13h 17m	373	2