Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

PostgreSQL 18 on SQLite

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.7	0.2747	$697.58	718.7M	2.2M	19h 51m	2979	27
2	Grok 4.7	0.2637	$767.04	780.4M	2.4M	18h 58m	3117	30
3	Grok 4.7	0.2527	$961.79	986.1M	3.0M	20h 0m	3909	26
4	Grok 4.7	0.1978	$1004.11	1036.8M	3.4M	20h 0m	4217	22
5	Grok 4.7	0.0000	$890.38	903.6M	3.1M	20h 0m	3660	12