Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-5.6	0.9807	$221.16	222.7M	429k	6h 13m	691	19
2	GPT-5.6	0.9791	$78.01	86.8M	272k	4h 32m	395	2
3	GPT-5.6	0.9757	$207.31	199.1M	381k	7h 23m	620	10
4	GPT-5.6	0.9339	$340.15	337.0M	382k	8h 35m	789	11
5	GPT-5.6	0.7874	$397.16	404.0M	396k	8h 54m	1134	7