Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Kolmogorov Audio Compression

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.0313	$38.45	102.2M	362k	20h 1m	397	10
2	Kimi K3	0.0266	$26.15	60.2M	321k	19h 29m	303	13
3	Kimi K3	0.0251	$50.26	120.4M	460k	19h 45m	410	7
4	Kimi K3	0.0250	$34.53	93.2M	354k	19h 44m	395	8
5	Kimi K3	0.0120	$62.95	172.7M	576k	20h 0m	473	15

Astronomy Toolkit

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.6250	$60.98	152.4M	478k	16h 31m	414	12
2	Kimi K3	0.3983	$90.41	238.0M	505k	20h 1m	587	20
3	Kimi K3	0.3959	$20.08	46.3M	279k	6h 2m	205	5
4	Kimi K3	0.3804	$70.49	167.8M	452k	19h 35m	468	8
5	Kimi K3	0.2995	$53.30	137.6M	418k	11h 54m	430	7

Cranelift Codegen Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.0603	$148.59	441.7M	786k	16h 22m	1028	15
2	Kimi K3	0.0478	$126.89	362.2M	801k	17h 53m	936	9
3	Kimi K3	0.0132	$145.36	415.9M	1.0M	20h 3m	1079	7
4	Kimi K3	0.0000	$136.80	389.4M	1.1M	20h 0m	1006	19
5	Kimi K3	0.0000	$136.72	403.0M	752k	19h 8m	1147	11

Dart Style in Haskell

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.5650	$209.81	607.6M	1.3M	20h 1m	1454	19
2	Kimi K3	0.5395	$190.44	541.2M	1.2M	19h 50m	1336	3
3	Kimi K3	0.4874	$196.59	547.1M	1.3M	19h 46m	1241	8
4	Kimi K3	0.4305	$123.27	338.1M	738k	19h 52m	670	1
5	Kimi K3	0.0000	$86.57	238.4M	589k	20h 1m	593	1

FFmpeg libswscale Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.1260	$127.79	342.6M	1.2M	13h 59m	827	13
2	Kimi K3	0.1252	$211.22	606.6M	1.4M	19h 43m	1382	3
3	Kimi K3	0.0799	$127.97	356.2M	1.1M	15h 4m	914	11
4	Kimi K3	0.0639	$138.03	382.3M	1.1M	17h 32m	902	2
5	Kimi K3	0.0000	$171.14	500.1M	1.1M	19h 41m	1175	47

Crash-Proof Flash Filesystem

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.0431	$197.20	550.4M	1.5M	20h 1m	1197	1
2	Kimi K3	0.0112	$202.76	569.3M	1.5M	19h 50m	1237	2
3	Kimi K3	0.0049	$158.40	411.0M	1.7M	20h 0m	1010	1
4	Kimi K3	0.0049	$190.49	508.0M	1.5M	19h 54m	1111	9
5	Kimi K3	0.0008	$195.88	529.5M	1.7M	20h 0m	1266	2

FrogsGame Post-Training

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.4620	$12.73	24.9M	159k	19h 34m	172	1
2	Kimi K3	0.3000	$16.00	38.1M	240k	20h 0m	187	1
3	Kimi K3	0.1900	$13.63	32.0M	177k	20h 0m	198	1
4	Kimi K3	0.1040	$11.13	20.9M	147k	19h 47m	174	1
5	Kimi K3	0.0660	$8.10	17.2M	123k	19h 18m	153	1

Stepper Music Sequencer GBA

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.5098	$230.68	643.2M	1.9M	20h 0m	1545	3
2	Kimi K3	0.3706	$227.60	629.2M	1.9M	19h 47m	1504	2
3	Kimi K3	0.3170	$227.44	622.4M	1.9M	19h 52m	1439	1
4	Kimi K3	0.1336	$196.38	508.8M	1.8M	19h 51m	1209	4
5	Kimi K3	0.0909	$184.74	495.2M	1.5M	19h 58m	1154	2

Git to Zig

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.1768	$251.00	752.4M	1.2M	20h 2m	1619	1
2	Kimi K3	0.1733	$200.20	602.7M	965k	19h 43m	1483	13
3	Kimi K3	0.1616	$254.18	761.8M	1.1M	19h 47m	1668	9
4	Kimi K3	0.1574	$259.84	779.9M	1.1M	19h 53m	1765	2
5	Kimi K3	0.1473	$222.64	660.4M	1.1M	19h 44m	1491	1

Granite Mamba2 Inference Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.7872	$122.78	337.3M	986k	19h 10m	771	36
2	Kimi K3	0.7805	$103.11	286.2M	907k	14h 49m	651	10
3	Kimi K3	0.7571	$91.87	248.8M	620k	20h 0m	531	50
4	Kimi K3	0.7477	$74.48	205.5M	639k	8h 3m	456	20
5	Kimi K3	0.6169	$112.73	307.9M	980k	13h 16m	708	31

Higgs Uncertainty Inference

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.9593	$29.55	62.1M	341k	12h 49m	285	15
2	Kimi K3	0.4200	$32.18	58.0M	281k	15h 50m	280	8
3	Kimi K3	0.0960	$32.35	77.4M	380k	13h 56m	311	15
4	Kimi K3	0.0626	$34.08	68.6M	372k	14h 20m	275	12
5	Kimi K3	0.0289	$90.08	230.0M	659k	20h 0m	555	1

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.0103	$110.14	311.1M	507k	20h 1m	740	11
2	Kimi K3	0.0000	$185.83	517.0M	1.5M	20h 0m	1188	13
3	Kimi K3	0.0000	$246.45	710.4M	1.8M	20h 0m	1736	14
4	Kimi K3	0.0000	$49.64	141.5M	328k	6h 19m	529	7
5	Kimi K3	0.0000	$124.72	355.5M	911k	15h 41m	948	24

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.9198	$192.68	537.9M	1.4M	20h 0m	1218	1
2	Kimi K3	0.8313	$155.97	405.9M	1.5M	19h 47m	935	3
3	Kimi K3	0.5265	$147.65	387.7M	1.4M	20h 2m	894	1
4	Kimi K3	0.4229	$171.33	477.1M	1.3M	19h 55m	1130	12
5	Kimi K3	0.2644	$151.43	423.8M	1.1M	20h 1m	928	1

libexpat Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.1778	$238.01	679.3M	1.8M	19h 52m	1588	83
2	Kimi K3	0.1513	$169.56	484.2M	1.2M	19h 34m	1155	16
3	Kimi K3	0.1288	$173.14	509.0M	1.1M	13h 23m	1149	28
4	Kimi K3	0.0000	$214.44	584.8M	1.8M	20h 0m	1459	1
5	Kimi K3	0.0000	$256.75	739.1M	1.4M	20h 0m	1576	1

Lua Native Compiler

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.9575	$183.51	524.3M	1.3M	19h 59m	1203	20
2	Kimi K3	0.8750	$185.22	530.7M	1.3M	20h 0m	1207	1
3	Kimi K3	0.5063	$220.93	645.6M	1.2M	20h 2m	1461	1
4	Kimi K3	0.2862	$159.88	431.8M	1.4M	19h 11m	1009	1
5	Kimi K3	0.0000	$228.55	670.7M	1.4M	19h 8m	1408	3

Machine-Learned Interatomic Potential

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.9282	$14.81	21.6M	194k	19h 20m	175	3
2	Kimi K3	0.9177	$11.72	20.5M	161k	18h 47m	165	3
3	Kimi K3	0.8916	$6.54	9.0M	95k	18h 28m	126	2
4	Kimi K3	0.8033	$15.11	21.0M	176k	19h 11m	168	3
5	Kimi K3	0.7378	$9.88	13.2M	119k	19h 28m	143	2

Medium-Range Weather Forecast

task page →5 runs · indexed 2026-09-02

#	Model	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	$20.25	49.9M	257k	19h 31m	296	8
2	Kimi K3	$16.03	42.3M	172k	19h 35m	282	1
3	Kimi K3	$13.29	32.3M	193k	19h 22m	245	2
4	Kimi K3	$11.04	28.1M	135k	19h 31m	261	6
5	Kimi K3	$19.09	48.5M	196k	18h 52m	326	6

MEG Speech Decoding

task page →1 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.1102	$14.90	32.2M	173k	18h 22m	254	3

Wan 2.1 on MAX/Mojo

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.9307	$34.42	90.2M	306k	9h 26m	306	5
2	Kimi K3	0.9196	$29.20	75.3M	345k	8h 0m	286	8
3	Kimi K3	0.9090	$15.06	37.9M	188k	7h 2m	204	7
4	Kimi K3	0.8899	$31.51	84.6M	291k	12h 22m	348	3
5	Kimi K3	0.2838	$85.29	208.6M	954k	19h 56m	558	3

MS/MS De Novo Generation

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.1101	$21.35	46.7M	229k	17h 35m	282	6
2	Kimi K3	0.1097	$26.90	62.8M	258k	19h 1m	325	7
3	Kimi K3	0.1091	$18.21	39.5M	209k	19h 3m	239	5
4	Kimi K3	0.0000	$18.66	38.3M	209k	20h 0m	254	4
5	Kimi K3	0.0000	$31.98	77.8M	334k	19h 25m	339	4

Multi-GPU Efficient Finetuning

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.3333	$19.15	18.0M	131k	19h 9m	167	6
2	Kimi K3	0.3095	$16.56	15.3M	148k	19h 10m	134	3
3	Kimi K3	0.1905	$16.13	11.8M	128k	18h 47m	116	1
4	Kimi K3	0.0476	$25.13	35.1M	233k	19h 37m	236	1
5	Kimi K3	0.0000	$10.94	8.7M	101k	18h 40m	121	1

Notebook Compression

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.2647	$37.66	96.4M	363k	19h 31m	409	17
2	Kimi K3	0.2338	$43.76	111.9M	405k	17h 35m	403	12
3	Kimi K3	0.2242	$36.27	87.9M	412k	11h 52m	382	12
4	Kimi K3	0.2151	$24.45	60.7M	274k	11h 45m	302	10
5	Kimi K3	0.1961	$13.59	21.1M	194k	9h 53m	179	9

Flight-Sim Renderer in OpenGL

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.0249	$126.07	350.4M	1.1M	19h 56m	936	7
2	Kimi K3	0.0214	$168.60	476.4M	1.3M	20h 1m	1079	5
3	Kimi K3	0.0104	$167.00	460.9M	1.4M	20h 1m	1039	1
4	Kimi K3	0.0079	$184.18	516.4M	1.3M	19h 37m	1094	2
5	Kimi K3	0.0000	$182.81	498.0M	1.4M	20h 1m	1063	2

Optimizer Design

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.3057	$15.06	37.2M	181k	19h 11m	275	4
2	Kimi K3	0.1475	$41.51	100.0M	508k	20h 1m	354	4
3	Kimi K3	0.1370	$16.05	38.0M	228k	19h 25m	222	4
4	Kimi K3	0.0990	$22.58	49.0M	297k	17h 53m	241	6
5	Kimi K3	0.0000	$19.05	42.1M	297k	14h 45m	219	3

PostgreSQL 18 on SQLite

task page →4 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.0714	$227.56	673.8M	1.2M	20h 0m	1528	1
2	Kimi K3	0.0659	$265.37	772.2M	1.4M	20h 1m	1427	1
3	Kimi K3	0.0604	$238.20	702.8M	1.4M	20h 1m	1513	1
4	Kimi K3	0.0495	$197.52	561.9M	1.3M	20h 0m	1168	1

Quantum ESPRESSO pw.x in Rust

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.2602	$75.00	147.3M	1.2M	19h 51m	428	1
2	Kimi K3	0.0488	$160.13	415.5M	1.7M	20h 0m	999	1
3	Kimi K3	0.0244	$100.42	211.3M	1.8M	20h 0m	566	1
4	Kimi K3	0.0081	$131.87	355.0M	1.3M	19h 56m	785	6
5	Kimi K3	0.0000	$72.76	158.2M	1.2M	20h 1m	418	1

Qubit Routing

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.7526	$40.44	107.3M	401k	19h 37m	387	17
2	Kimi K3	0.7151	$55.15	146.5M	497k	20h 0m	484	14
3	Kimi K3	0.6987	$79.07	224.2M	641k	20h 1m	556	12
4	Kimi K3	0.6270	$30.79	76.7M	394k	12h 20m	318	20
5	Kimi K3	0.6254	$97.66	258.3M	819k	19h 58m	576	17

Reconnaissance Blind Chess Recovery

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.7571	$29.23	77.1M	277k	14h 20m	314	2
2	Kimi K3	0.5071	$31.51	82.4M	325k	14h 46m	311	4
3	Kimi K3	0.4286	$27.43	64.3M	286k	14h 50m	256	11
4	Kimi K3	0.3143	$28.91	69.9M	341k	12h 50m	253	2
5	Kimi K3	0.1429	$43.61	116.1M	397k	14h 40m	395	2

Fitness-Recap Video in Remotion

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.1767	$191.75	571.0M	982k	19h 53m	1356	3
2	Kimi K3	0.1723	$171.83	504.1M	1.1M	19h 44m	1234	8
3	Kimi K3	0.1716	$266.42	802.2M	1.3M	20h 1m	1618	1
4	Kimi K3	0.0657	$243.01	727.7M	1.1M	20h 1m	1633	1
5	Kimi K3	0.0536	$202.63	587.9M	1.0M	19h 57m	1479	12

Snooker Prediction

task page →5 runs · indexed 2026-09-02

#	Model	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	$126.53	346.0M	738k	19h 31m	778	8
2	Kimi K3	$140.38	372.9M	1.4M	19h 51m	925	26
3	Kimi K3	$122.14	346.5M	798k	19h 47m	793	8
4	Kimi K3	$117.31	316.7M	1.0M	19h 47m	806	6
5	Kimi K3	$105.21	273.3M	660k	20h 0m	548	3

SPICE Circuit Simulator in Rust

task page →5 runs · indexed 2026-09-02

#	Model	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	$179.57	474.0M	1.9M	19h 42m	1215	9
2	Kimi K3	$215.15	588.2M	1.9M	19h 56m	1405	3
3	Kimi K3	$199.08	565.4M	1.4M	19h 58m	1271	1
4	Kimi K3	$204.94	570.3M	1.7M	19h 34m	1399	3
5	Kimi K3	$193.03	529.1M	1.8M	19h 58m	1263	1

Synthetic Music Diarization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.4318	$13.36	33.2M	179k	18h 52m	244	5
2	Kimi K3	0.4157	$22.81	60.7M	202k	19h 10m	347	7
3	Kimi K3	0.4034	$13.34	31.5M	191k	18h 19m	247	4
4	Kimi K3	0.3852	$16.48	39.9M	237k	19h 5m	234	2
5	Kimi K3	0.3635	$16.00	39.1M	227k	18h 59m	234	6

Vision-only TORCS Racing Bot

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.0612	$51.38	138.7M	388k	19h 16m	456	9
2	Kimi K3	0.0382	$61.72	163.7M	377k	19h 53m	534	3
3	Kimi K3	0.0211	$44.44	114.5M	382k	20h 0m	386	1
4	Kimi K3	0.0143	$59.95	154.4M	389k	20h 1m	507	2
5	Kimi K3	0.0000†	$56.92	159.4M	376k	20h 0m	521	1

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.

Verilog Simulator in Swift

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Kimi K3	0.8373	$248.18	704.4M	1.6M	20h 0m	1636	11
2	Kimi K3	0.7551	$141.93	387.6M	1.1M	20h 1m	1009	1
3	Kimi K3	0.7175	$256.44	747.8M	1.5M	20h 1m	1669	2
4	Kimi K3	0.6849	$265.41	774.0M	1.6M	19h 54m	1682	2
5	Kimi K3	0.6250	$235.66	685.5M	1.4M	19h 49m	1521	1