Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

libexpat Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.1479	$150.76	148.7M	804k	4h 11m	580	26
2	Grok 4.6	0.1393	$108.10	108.1M	736k	4h 5m	435	11
3	Grok 4.6	0.1022	$79.42	75.8M	516k	2h 56m	273	7
4	Grok 4.6	0.0000	$93.77	99.5M	677k	3h 26m	435	10
5	Grok 4.6	0.0000	$71.78	70.3M	399k	1h 58m	277	5