Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Kolmogorov Audio Compression

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.0369	$28.71	91.1M	330k	19h 38m	343	2
2	GLM-5.3	0.0349	$48.94	118.7M	352k	19h 6m	384	2
3	GLM-5.3	0.0298	$35.18	91.1M	311k	19h 41m	366	13
4	GLM-5.3	0.0264	$29.01	75.1M	335k	17h 41m	311	6
5	GLM-5.3	0.0243	$29.39	96.9M	323k	19h 43m	356	1

Astronomy Toolkit

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.6985	$72.52	246.9M	707k	19h 16m	599	6
2	GLM-5.3	0.4028	$57.26	195.8M	552k	12h 7m	426	8
3	GLM-5.3	0.4017	$72.89	226.5M	514k	17h 29m	476	6
4	GLM-5.3	0.3930	$77.97	220.3M	559k	15h 22m	481	2
5	GLM-5.3	0.2893	$64.65	196.5M	549k	19h 1m	419	8

Cranelift Codegen Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.0162	$93.99	346.3M	474k	11h 28m	766	2
2	GLM-5.3	0.0129	$109.37	311.0M	484k	17h 22m	770	9
3	GLM-5.3	0.0102	$60.68	223.7M	392k	7h 14m	615	4
4	GLM-5.3	0.0000	$110.08	353.7M	515k	18h 43m	761	18
5	GLM-5.3	0.0000	$69.79	258.7M	392k	7h 49m	703	7

Dart Style in Haskell

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.5299	$165.74	599.8M	1.1M	19h 6m	1398	51
2	GLM-5.3	0.4696	$158.77	595.9M	645k	19h 33m	1177	12
3	GLM-5.3	0.4653	$144.84	516.1M	611k	19h 39m	1066	22
4	GLM-5.3	0.4595	$150.71	560.0M	706k	19h 32m	1263	35
5	GLM-5.3	0.3788	$98.82	359.7M	600k	20h 0m	738	1

FFmpeg libswscale Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.1752	$226.40	818.4M	2.0M	19h 33m	1884	18
2	GLM-5.3	0.1410	$148.35	524.2M	1.7M	16h 26m	1303	8
3	GLM-5.3	0.1369	$139.76	505.8M	1.2M	11h 14m	1097	9
4	GLM-5.3	0.1231	$175.55	619.5M	1.7M	16h 47m	1509	8
5	GLM-5.3	0.0783	$177.95	625.3M	1.7M	17h 1m	1420	8

Crash-Proof Flash Filesystem

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.0173	$171.41	627.5M	1.2M	19h 32m	1385	14
2	GLM-5.3	0.0173	$236.98	874.4M	1.4M	19h 51m	1908	31
3	GLM-5.3	0.0111	$148.21	526.6M	1.0M	18h 49m	1175	16
4	GLM-5.3	0.0049	$108.31	386.0M	1.3M	16h 54m	851	5
5	GLM-5.3	0.0039	$154.89	566.6M	1.0M	19h 45m	1350	18

FrogsGame Post-Training

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.8380	$21.95	47.4M	206k	19h 31m	233	2
2	GLM-5.3	0.7220	$12.91	44.6M	176k	19h 17m	247	2
3	GLM-5.3	0.3120	$16.40	57.5M	195k	19h 21m	314	2
4	GLM-5.3	0.1640	$20.82	41.0M	222k	19h 4m	214	3
5	GLM-5.3	0.1580	$16.59	58.5M	233k	19h 38m	265	1

Stepper Music Sequencer GBA

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.6108	$356.80	1301.6M	3.0M	19h 1m	2671	19
2	GLM-5.3	0.4715	$281.50	1008.4M	2.3M	16h 6m	2264	16
3	GLM-5.3	0.4046	$276.19	1010.3M	1.8M	15h 31m	2070	21
4	GLM-5.3	0.3427	$275.26	1018.0M	1.7M	17h 39m	2090	39
5	GLM-5.3	0.1440	$63.57	232.5M	498k	3h 14m	487	6

Git to Zig

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.1556	$225.36	842.0M	964k	19h 45m	2012	17
2	GLM-5.3	0.1531	$195.54	692.6M	689k	19h 54m	1480	2
3	GLM-5.3	0.1390	$212.77	708.2M	852k	19h 49m	1640	49
4	GLM-5.3	0.1378	$248.79	932.5M	906k	19h 55m	2219	21
5	GLM-5.3	0.1219	$188.86	712.0M	621k	19h 43m	1318	16

Granite Mamba2 Inference Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.8927	$85.79	297.0M	636k	6h 7m	634	7
2	GLM-5.3	0.8719	$51.39	174.8M	618k	4h 8m	382	8
3	GLM-5.3	0.8401	$45.93	158.7M	655k	5h 28m	343	6
4	GLM-5.3	0.7528	$38.94	126.7M	486k	4h 14m	351	5
5	GLM-5.3	0.7402	$85.05	310.6M	673k	18h 16m	645	8

Higgs Uncertainty Inference

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.1632	$24.11	84.1M	350k	8h 48m	310	8
2	GLM-5.3	0.1005	$24.46	71.1M	367k	17h 31m	283	7
3	GLM-5.3	0.0517	$9.91	30.6M	263k	2h 10m	167	5
4	GLM-5.3	0.0375	$14.94	49.5M	308k	3h 28m	223	2
5	GLM-5.3	0.0251	$17.68	60.0M	356k	3h 29m	246	3

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.0534	$68.77	241.2M	448k	15h 36m	650	8
2	GLM-5.3	0.0211	$67.37	244.9M	383k	14h 17m	698	20
3	GLM-5.3	0.0004	$46.58	170.2M	369k	10h 37m	591	7
4	GLM-5.3	0.0000	$50.83	180.8M	386k	12h 52m	576	4
5	GLM-5.3	0.0000	$68.85	206.5M	390k	14h 23m	607	17

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.8650	$139.71	481.8M	637k	18h 8m	859	6
2	GLM-5.3	0.8372	$111.12	401.3M	867k	19h 42m	904	10
3	GLM-5.3	0.4065	$133.87	385.6M	660k	19h 35m	677	3
4	GLM-5.3	0.1056	$134.85	474.9M	964k	19h 7m	1105	3
5	GLM-5.3	0.0000	$113.59	400.7M	1.0M	18h 31m	962	5

libexpat Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.2372	$181.79	673.8M	1.1M	8h 14m	1501	3
2	GLM-5.3	0.2303	$183.58	670.1M	1.1M	9h 50m	1460	18
3	GLM-5.3	0.1823	$327.58	1209.3M	1.8M	18h 23m	2635	46
4	GLM-5.3	0.1583	$236.28	865.5M	1.6M	18h 53m	1991	34
5	GLM-5.3	0.0000	$216.67	774.3M	1.6M	16h 7m	1754	19

Lua Native Compiler

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.9976	$201.34	735.2M	1.4M	11h 37m	1660	3
2	GLM-5.3	0.9953	$142.13	511.6M	1.2M	9h 22m	1178	2
3	GLM-5.3	0.9599	$274.76	1000.1M	1.8M	19h 32m	2273	5
4	GLM-5.3	0.9527	$236.30	883.7M	1.1M	17h 20m	1835	7
5	GLM-5.3	0.0000	$251.10	909.6M	1.3M	19h 55m	1918	6

Machine-Learned Interatomic Potential

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.9901	$21.35	50.8M	160k	19h 5m	353	1
2	GLM-5.3	0.9615	$15.62	37.8M	156k	19h 29m	294	2
3	GLM-5.3	0.9184	$31.31	62.0M	243k	18h 46m	307	2
4	GLM-5.3	0.8163	$20.32	55.4M	207k	19h 30m	350	2
5	GLM-5.3	0.7858	$25.28	49.5M	200k	18h 31m	285	2

Medium-Range Weather Forecast

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.5873	$22.61	71.9M	228k	18h 20m	314	2
2	GLM-5.3	0.4818	$19.75	47.5M	201k	18h 1m	273	5
3	GLM-5.3	0.4745	$28.03	96.3M	327k	19h 20m	363	7
4	GLM-5.3	0.4723	$21.03	47.8M	206k	18h 36m	293	2
5	GLM-5.3	0.4679	$26.30	77.9M	252k	19h 29m	364	2

MEG Speech Decoding

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.2244	$22.68	51.0M	188k	18h 6m	315	2
2	GLM-5.3	0.2036	$34.96	74.2M	244k	14h 55m	372	2
3	GLM-5.3	0.1492	$27.34	90.5M	318k	15h 42m	371	3
4	GLM-5.3	0.1032	$33.80	77.7M	262k	19h 7m	353	2
5	GLM-5.3	0.0000	$49.90	134.3M	340k	19h 4m	469	21

Wan 2.1 on MAX/Mojo

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.9144	$51.16	175.7M	465k	14h 14m	461	2
2	GLM-5.3	0.9094	$42.10	140.4M	401k	16h 39m	404	2
3	GLM-5.3	0.9087	$43.47	155.3M	374k	16h 47m	478	2
4	GLM-5.3	0.0945	$60.08	134.7M	351k	20h 1m	432	1
5	GLM-5.3	0.0239	$77.39	173.5M	511k	19h 46m	464	11

MS/MS De Novo Generation

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.1050	$34.13	75.8M	305k	18h 42m	336	2
2	GLM-5.3	0.1036	$36.94	94.3M	365k	18h 38m	359	3
3	GLM-5.3	0.0941	$44.44	143.9M	417k	17h 20m	450	8
4	GLM-5.3	0.0000	$28.55	71.5M	295k	19h 12m	332	2
5	GLM-5.3	0.0000	$43.34	125.4M	382k	18h 56m	463	2

Multi-GPU Efficient Finetuning

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.2857	$12.88	26.8M	144k	19h 0m	234	2
2	GLM-5.3	0.2857	$10.42	18.4M	127k	19h 10m	175	6
3	GLM-5.3	0.0714	$17.61	33.2M	221k	18h 56m	211	2
4	GLM-5.3	0.0000	$20.26	34.9M	208k	19h 31m	211	4
5	GLM-5.3	0.0000	$17.67	32.5M	199k	19h 29m	215	2

Notebook Compression

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.2770	$25.86	86.5M	327k	19h 49m	370	3
2	GLM-5.3	0.2744	$34.96	116.4M	391k	19h 2m	435	2
3	GLM-5.3	0.2089	$39.28	89.8M	362k	20h 0m	369	1
4	GLM-5.3	0.2058	$59.65	209.0M	565k	15h 11m	548	8
5	GLM-5.3	0.1261	$28.93	86.9M	409k	13h 16m	328	2

Flight-Sim Renderer in OpenGL

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.0166	$91.30	316.9M	852k	19h 35m	891	7
2	GLM-5.3	0.0054	$111.06	362.5M	755k	19h 29m	893	10
3	GLM-5.3	0.0038	$97.66	297.0M	573k	19h 4m	633	5
4	GLM-5.3	0.0006	$94.18	300.9M	621k	18h 57m	592	10
5	GLM-5.3	0.0000	$103.09	375.1M	554k	19h 46m	790	12

Optimizer Design

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.2349	$19.98	35.0M	224k	17h 41m	192	3
2	GLM-5.3	0.2192	$17.37	36.9M	195k	19h 6m	241	2
3	GLM-5.3	0.2082	$16.48	26.8M	198k	19h 23m	184	3
4	GLM-5.3	0.0984	$17.01	55.5M	261k	19h 4m	277	5
5	GLM-5.3	0.0965	$13.47	23.0M	159k	18h 59m	180	2

PostgreSQL 18 on SQLite

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.1593	$191.86	711.5M	862k	19h 53m	1746	17
2	GLM-5.3	0.1484	$202.20	744.7M	1.0M	19h 42m	1789	7
3	GLM-5.3	0.1374	$201.89	706.7M	843k	19h 32m	1585	9
4	GLM-5.3	0.1374	$155.77	570.5M	772k	19h 52m	1384	2
5	GLM-5.3	0.0989	$219.76	822.5M	966k	19h 50m	1903	11

Quantum ESPRESSO pw.x in Rust

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.1707	$145.94	507.1M	1.3M	19h 30m	1082	13
2	GLM-5.3	0.1382	$132.96	476.8M	1.3M	19h 42m	984	12
3	GLM-5.3	0.1301	$108.12	382.4M	1.3M	19h 32m	838	2
4	GLM-5.3	0.0650	$123.53	403.7M	1.6M	19h 19m	957	11
5	GLM-5.3	0.0000	$103.68	348.9M	1.2M	19h 23m	795	14

Qubit Routing

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.7535	$23.46	64.7M	277k	19h 3m	267	6
2	GLM-5.3	0.7343	$45.48	90.2M	303k	16h 27m	365	4
3	GLM-5.3	0.6907	$44.40	135.6M	383k	15h 8m	392	12
4	GLM-5.3	0.6370	$18.59	55.0M	231k	19h 13m	287	3
5	GLM-5.3	0.6071	$32.20	106.0M	372k	12h 23m	375	5

Reconnaissance Blind Chess Recovery

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.5357	$48.03	138.0M	410k	14h 33m	388	9
2	GLM-5.3	0.4214	$29.52	79.9M	302k	14h 26m	305	6
3	GLM-5.3	0.3607	$36.05	73.5M	339k	13h 30m	259	4
4	GLM-5.3	0.2893	$25.26	83.8M	284k	14h 38m	339	4
5	GLM-5.3	0.2571	$27.02	69.8M	315k	14h 43m	253	6

Fitness-Recap Video in Remotion

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.1894	$78.50	212.7M	442k	18h 20m	530	6
2	GLM-5.3	0.1828	$113.14	407.8M	483k	19h 2m	804	9
3	GLM-5.3	0.1426	$118.44	380.0M	784k	18h 55m	986	18
4	GLM-5.3	0.1053	$110.52	388.9M	908k	15h 36m	961	9
5	GLM-5.3	0.0837	$90.93	307.2M	485k	16h 10m	636	8

Snooker Prediction

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.1976	$71.12	251.5M	765k	18h 56m	654	15
2	GLM-5.3	0.1013	$57.78	201.7M	793k	14h 16m	531	13
3	GLM-5.3	0.0590	$53.37	163.6M	430k	17h 18m	373	6
4	GLM-5.3	0.0311	$89.97	246.3M	519k	19h 15m	495	13
5	GLM-5.3	0.0000	$94.15	290.7M	465k	18h 52m	627	11

SPICE Circuit Simulator in Rust

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.5354	$171.96	618.6M	1.7M	18h 15m	1441	4
2	GLM-5.3	0.4949	$235.96	867.9M	1.6M	17h 11m	1905	18
3	GLM-5.3	0.4444	$158.88	578.0M	1.3M	10h 53m	1155	4
4	GLM-5.3	0.4141	$190.24	693.2M	1.5M	19h 41m	1705	30
5	GLM-5.3	0.3131	$152.26	545.3M	1.3M	16h 57m	1164	23

Synthetic Music Diarization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.4816	$35.34	125.4M	361k	17h 30m	462	11
2	GLM-5.3	0.4802	$31.62	79.0M	303k	18h 9m	361	1
3	GLM-5.3	0.4602	$19.77	41.7M	196k	19h 9m	253	4
4	GLM-5.3	0.4285	$28.03	77.4M	258k	18h 22m	366	9
5	GLM-5.3	0.4265	$27.27	78.5M	240k	19h 37m	374	6

Vision-only TORCS Racing Bot

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.0490	$52.08	118.9M	330k	18h 59m	354	2
2	GLM-5.3	0.0406	$79.08	158.6M	318k	18h 36m	406	8
3	GLM-5.3	0.0363	$101.89	234.7M	397k	19h 55m	487	1
4	GLM-5.3	0.0278	$99.55	248.0M	367k	18h 54m	563	14
5	GLM-5.3	0.0180	$78.52	153.1M	353k	18h 42m	396	9

Verilog Simulator in Swift

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GLM-5.3	0.8236	$236.70	879.4M	1.3M	20h 1m	1924	11
2	GLM-5.3	0.8151	$195.25	722.0M	1.1M	19h 28m	1706	10
3	GLM-5.3	0.7757	$229.93	817.6M	1.1M	19h 47m	1800	19
4	GLM-5.3	0.7723	$247.89	875.5M	1.2M	19h 55m	1804	17
5	GLM-5.3	0.7551	$285.37	1061.6M	1.4M	19h 46m	2367	23