Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

FrogsGame Post-Training

task page →110 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Sonnet 5.5	0.9920	$41.94	172.9M	571k	18h 38m	358	1
2	Claude Sonnet 5.5	0.9920	$37.06	145.6M	621k	18h 34m	289	4
3	Claude Sonnet 5.5	0.9860	$40.55	166.2M	572k	19h 5m	363	1
4	Claude Fable 5.1	0.9740	$14.41	21.9M	144k	17h 0m	153	5
5	GPT-6 Astra	0.9700	$116.67	60.2M	205k	18h 38m	255	8
6	Claude Opus 5.5	0.9380	$18.10	54.0M	277k	17h 56m	203	3
7	Claude Sonnet 5.5	0.9380	$31.79	125.6M	517k	19h 26m	294	2
8	Claude Opus 5.5	0.9340	$25.67	82.0M	341k	18h 34m	248	6
9	Claude Opus 5.5	0.9320	$21.18	64.6M	311k	18h 52m	228	5
10	GPT-6 Astra	0.9160	$256.74	124.3M	279k	19h 10m	365	11
11	Claude Sonnet 5.5	0.9160	$33.87	130.0M	616k	16h 46m	279	3
12	Claude Opus 5.5	0.9060	$27.72	93.7M	337k	17h 43m	292	4
13	GPT-6 Astra	0.9000	$49.97	27.6M	160k	19h 17m	158	6
14	Gemini 4 Argon	0.8920	$46.04	49.7M	235k	14h 34m	172	5
15	Claude Fable 5.1	0.8920	$12.71	19.5M	122k	16h 12m	146	4
16	Claude Haiku 5.5	0.8900	$4.98	80.9M	361k	18h 50m	247	5
17	GPT-6 Astra	0.8840	$265.88	128.3M	310k	19h 14m	390	8
18	Claude Haiku 5.5	0.8580	$5.65	92.0M	404k	18h 43m	272	1
19	Claude Haiku 5.5	0.8540	$5.01	78.6M	413k	17h 14m	235	1
20	GLM-5.3	0.8380	$21.95	47.4M	206k	19h 31m	233	2
21	Claude Opus 5.5	0.8240	$28.19	95.1M	341k	18h 8m	296	5
22	Gemini 4 Argon	0.8020	$82.91	62.7M	281k	14h 57m	166	4
23	Claude Fable 5.1	0.7800	$16.40	25.5M	151k	15h 15m	165	3
24	Claude Fable 5	0.7400	$44.21	30.2M	189k	19h 22m	191	4
25	GLM-5.3	0.7220	$12.91	44.6M	176k	19h 17m	247	2
26	Claude Opus 5	0.7140	$29.77	41.4M	245k	19h 28m	207	2
27	Gemini 4 Argon	0.6900	$75.10	61.9M	250k	17h 44m	191	4
28	Claude Opus 5	0.6840	$35.58	51.9M	259k	19h 2m	225	2
29	GPT-6 Astra	0.6760	$444.71	214.4M	392k	19h 40m	521	10
30	Claude Opus 5	0.6660	$32.36	44.1M	277k	18h 32m	192	4
31	Claude Fable 5.1	0.6180	$15.24	23.4M	145k	17h 43m	162	6
32	Muse Spark 1.3	0.6080	$42.76	36.7M	222k	19h 41m	241	2
33	Gemini 4 Argon	0.6040	$30.56	35.0M	214k	7h 42m	148	3
34	Gemini 4 Argon	0.5940	$87.69	65.7M	221k	8h 37m	175	3
35	Claude Fable 5	0.5920	$48.49	32.7M	211k	19h 14m	177	3
36	Claude Haiku 5.5	0.5500	$7.58	127.1M	460k	19h 19m	337	6
37	Claude Opus 5	0.5280	$40.04	56.7M	315k	17h 56m	222	4
38	Claude Haiku 5.5	0.5220	$5.68	92.2M	413k	18h 50m	284	2
39	Grok 4.7	0.4940	$60.79	36.4M	219k	19h 41m	169	1
40	Kimi K3	0.4620	$12.73	24.9M	159k	19h 34m	172	1
41	Claude Fable 5.1	0.4080	$13.04	19.3M	141k	15h 46m	135	4
42	Grok 4.7	0.3640	$259.38	236.3M	353k	19h 57m	795	2
43	GLM-5.3	0.3120	$16.40	57.5M	195k	19h 21m	314	2
44	Kimi K3	0.3000	$16.00	38.1M	240k	20h 0m	187	1
45	Grok 4.7	0.2980	$90.99	63.2M	209k	18h 43m	277	2
46	Claude Fable 5	0.2940	$55.28	38.9M	218k	19h 5m	196	4
47	Grok 4.7	0.2920	$118.94	66.1M	194k	19h 26m	282	2
48	Claude Opus 5	0.2740	$33.23	45.6M	283k	19h 1m	200	2
49	Claude Fable 5	0.2640	$49.52	34.1M	206k	18h 52m	186	4
50	Grok 4.6	0.2460	$18.57	19.8M	283k	19h 59m	152	1
51	Grok 4.6	0.2420	$9.68	12.9M	262k	19h 22m	132	2
52	Qwen3.8-Max	0.2160	$11.97	38.7M	277k	19h 34m	297	3
53	Kimi K3	0.1900	$13.63	32.0M	177k	20h 0m	198	1
54	GLM-5.3	0.1640	$20.82	41.0M	222k	19h 4m	214	3
55	GLM-5.3	0.1580	$16.59	58.5M	233k	19h 38m	265	1
56	Claude Fable 5	0.1360	$52.26	35.5M	227k	18h 52m	183	4
57	Muse Spark 1.3	0.1340	$12.49	16.7M	201k	19h 20m	179	3
58	Grok 4.6	0.1280	$47.67	45.1M	287k	18h 35m	259	5
59	DeepSeek V4 Flash Vision Exp	0.1100	$1.27	65.0M	240k	20h 4m	306	1
60	GLM-5.3 Flash	0.1040	$2.48	43.2M	239k	18h 52m	206	2
61	Kimi K3	0.1040	$11.13	20.9M	147k	19h 47m	174	1
62	GLM-5.3 Flash	0.1020	$2.48	58.2M	263k	18h 49m	267	2
63	Qwen3.8-Max	0.0980	$10.69	32.2M	339k	19h 46m	272	1
64	Gemini 3.8 Flash	0.0960	$23.82	139.9M	200k	8h 48m	450	31
65	Gemini 3.8 Flash	0.0900	$36.72	152.5M	162k	13h 5m	420	3
66	GPT-5.6 Sol	0.0900	$19.46	28.7M	100k	17h 8m	206	2
67	Qwen3.8-Max	0.0880	$5.85	16.5M	229k	19h 7m	195	1
68	DeepSeek V4 Flash Vision Exp	0.0860	$1.47	79.6M	227k	19h 17m	390	2
69	Qwen3.8-Max-0902	0.0680	$32.05	102.3M	870k	19h 37m	406	2
70	Kimi K3	0.0660	$8.10	17.2M	123k	19h 18m	153	1
71	Grok 4.6	0.0640	$49.02	43.5M	397k	19h 5m	221	4
72	Gemini 3.7 Flash	0.0620	$5.03	14.3M	76k	5h 27m	128	1
73	Muse Spark 1.3	0.0580	$11.26	13.8M	164k	19h 42m	163	3
74	GPT-5.6 Sol	0.0540	$20.87	32.1M	115k	12h 56m	241	3
75	Grok 4.7	0.0460	$50.68	36.5M	192k	18h 50m	196	2
76	GLM-5.3 Flash	0.0420	$2.01	26.5M	194k	19h 34m	169	1
77	Gemini 3.7 Flash	0.0420	$30.72	72.9M	130k	16h 34m	301	1
78	GPT-5.6 Sol	0.0380	$22.11	34.6M	103k	18h 7m	223	2
79	Muse Spark 1.3	0.0380	$29.75	31.6M	256k	19h 58m	261	1
80	GPT-5.6 Sol	0.0360	$61.31	64.5M	145k	15h 2m	277	2
81	Qwen3.8-Max	0.0360	$35.74	120.9M	650k	19h 55m	546	2
82	Gemini 3.8 Flash	0.0340	$11.75	59.4M	141k	7h 14m	276	4
83	Grok 4.6	0.0340	$48.29	46.2M	363k	16h 43m	237	5
84	Qwen3.8-Max-0902	0.0320	$32.58	103.5M	819k	19h 35m	415	2
85	Gemini 3.7 Flash	0.0320	$45.33	138.6M	173k	19h 58m	396	1
86	Muse Spark 1.3	0.0320	$20.03	29.7M	151k	19h 22m	241	1
87	Gemini 3.8 Flash	0.0300	$54.93	193.3M	322k	19h 11m	517	2
88	Qwen3.8-Max	0.0300	$11.98	37.6M	292k	18h 44m	323	4
89	Muse Spark 1.2	0.0300	$18.36	45.0M	166k	4h 11m	176	5
90	GLM-5.3 Flash	0.0280	$2.02	52.4M	227k	19h 53m	271	1
91	Gemini 3.8 Flash	0.0240	$6.62	28.1M	109k	3h 35m	158	2
92	Qwen3.8-Max-0902	0.0220	$35.21	102.2M	1.1M	19h 56m	399	—
93	Qwen3.8-Max-0902	0.0220	$33.10	101.6M	958k	19h 40m	430	3
94	Gemini 3.7 Flash	0.0220	$3.80	24.6M	101k	2h 41m	142	2
95	Muse Spark 1.2	0.0220	$21.74	48.9M	286k	5h 11m	239	11
96	Gemini 3.7 Flash	0.0200	$37.07	96.2M	140k	17h 26m	321	1
97	GLM-5.3 Flash	0.0160	$3.03	57.8M	247k	19h 17m	254	2
98	DeepSeek V4 Flash Vision Exp	0.0160	$1.33	68.9M	247k	19h 56m	345	2
99	DeepSeek V4 Flash Vision Exp	0.0160	$1.13	55.9M	221k	19h 37m	264	2
100	GPT-5.6 Sol	0.0120	$91.18	51.7M	86k	17h 41m	228	4
101	Muse Spark 1.2	0.0100	$18.40	105.2M	433k	4h 43m	251	5
102	Inkling	0.0080	$2.60	2.6M	22k	28m	84	2
103	Muse Spark 1.2	0.0060	$13.73	65.6M	312k	5h 25m	183	9
104	Inkling	0.0000	$8.37	8.7M	31k	38m	169	2
105	DeepSeek V4 Flash Vision Exp	0.0000	$1.61	87.5M	249k	20h 2m	395	1
106	Inkling	0.0000	$3.54	3.7M	16k	24m	97	2
107	Inkling	0.0000	$1.63	1.6M	18k	24m	71	2
108	Muse Spark 1.2	0.0000	$196.24	1245.9M	587k	4h 6m	2389	8
109	Qwen3.8-Max-0902	0.0000	$4.94	9.5M	357k	5h 14m	93	1
110	Inkling	0.0000	$2.52	2.6M	17k	28m	103	2