Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Kolmogorov Audio Compression

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.0221	$127.10	131.5M	617k	19h 58m	617	30
2	Grok 4.6	0.0192	$168.00	174.0M	498k	19h 58m	768	68
3	Grok 4.6	0.0171	$114.81	118.3M	558k	19h 40m	599	47
4	Grok 4.6	0.0126	$162.44	156.4M	577k	19h 37m	634	61
5	Grok 4.6	0.0106	$206.03	201.8M	768k	19h 59m	845	63

Astronomy Toolkit

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.5299	$15.57	15.6M	323k	1h 52m	106	4
2	Grok 4.6	0.3993	$48.11	46.2M	395k	3h 31m	208	6
3	Grok 4.6	0.2000	$34.68	34.5M	354k	2h 42m	175	8
4	Grok 4.6	0.1971	$39.66	35.3M	400k	3h 43m	165	11
5	Grok 4.6	0.0000	$23.09	23.9M	317k	4h 4m	152	3

Cranelift Codegen Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	$113.60	103.4M	918k	9h 35m	426	6
2	Grok 4.6	$240.25	234.7M	1.3M	16h 47m	895	24
3	Grok 4.6	$138.74	131.9M	1.2M	8h 47m	587	6
4	Grok 4.6	$138.58	127.2M	927k	7h 29m	488	9
5	Grok 4.6	$108.30	103.9M	740k	6h 37m	447	6

Dart Style in Haskell

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.5864	$513.86	512.7M	2.7M	20h 0m	2054	59
2	Grok 4.6	0.3015	$389.00	386.7M	2.2M	19h 53m	1645	42
3	Grok 4.6	0.1785	$547.31	552.2M	2.4M	19h 52m	2177	74
4	Grok 4.6	0.0000	$485.05	493.3M	2.2M	19h 52m	1992	109
5	Grok 4.6	0.0000	$402.09	394.7M	2.1M	17h 23m	1524	78

FFmpeg libswscale Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.0360	$419.25	404.2M	2.4M	19h 56m	1517	114
2	Grok 4.6	0.0000	$1121.42	1126.0M	2.4M	18h 11m	3693	434
3	Grok 4.6	0.0000	$68.40	59.6M	603k	3h 50m	229	4
4	Grok 4.6	0.0000	$132.56	129.2M	778k	5h 28m	562	27
5	Grok 4.6	0.0000	$380.75	368.6M	1.8M	11h 52m	1370	67

Crash-Proof Flash Filesystem

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.0610	$858.44	859.7M	2.4M	19h 46m	2990	501
2	Grok 4.6	0.0241	$445.27	424.9M	2.8M	19h 59m	1572	200
3	Grok 4.6	0.0117	$262.00	255.9M	1.7M	13h 11m	1039	20
4	Grok 4.6	0.0046	$267.41	252.9M	1.7M	10h 33m	927	132
5	Grok 4.6	0.0031	$181.59	175.3M	1.4M	8h 20m	693	24

FrogsGame Post-Training

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.2460	$18.57	19.8M	283k	19h 59m	152	1
2	Grok 4.6	0.2420	$9.68	12.9M	262k	19h 22m	132	2
3	Grok 4.6	0.1280	$47.67	45.1M	287k	18h 35m	259	5
4	Grok 4.6	0.0640	$49.02	43.5M	397k	19h 5m	221	4
5	Grok 4.6	0.0340	$48.29	46.2M	363k	16h 43m	237	5

Stepper Music Sequencer GBA

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.5671	$305.84	301.9M	2.2M	11h 0m	1227	45
2	Grok 4.6	0.3420	$868.26	872.5M	3.4M	16h 30m	3114	373
3	Grok 4.6	0.2607	$223.96	223.8M	1.5M	7h 20m	882	18
4	Grok 4.6	0.2416	$205.23	195.4M	1.9M	7h 34m	792	28
5	Grok 4.6	0.2197	$129.50	120.8M	2.0M	7h 52m	540	19

Git to Zig

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.1693	$652.70	657.8M	2.2M	19h 59m	2502	122
2	Grok 4.6	0.1618	$614.44	610.4M	2.6M	18h 0m	2324	73
3	Grok 4.6	0.1516	$806.68	819.7M	2.2M	19h 59m	2981	186
4	Grok 4.6	0.1352	$482.88	483.0M	1.6M	11h 22m	1767	84
5	Grok 4.6	0.1269	$408.61	405.7M	1.8M	19h 55m	1558	48

Granite Mamba2 Inference Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.7305	$58.74	52.8M	626k	4h 20m	206	13
2	Grok 4.6	0.7245	$46.67	39.7M	692k	3h 57m	169	10
3	Grok 4.6	0.6586	$55.70	47.5M	700k	4h 6m	194	10
4	Grok 4.6	0.6473	$57.88	51.1M	725k	4h 13m	210	5
5	Grok 4.6	0.2777	$27.64	23.0M	551k	3h 18m	127	2

Higgs Uncertainty Inference

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.9143	$37.23	34.8M	407k	3h 22m	158	10
2	Grok 4.6	0.8991	$42.77	39.2M	529k	3h 38m	183	9
3	Grok 4.6	0.8827	$39.92	37.7M	462k	3h 38m	181	8
4	Grok 4.6	0.8188	$274.70	264.2M	1.9M	19h 38m	1078	67
5	Grok 4.6	0.2104	$116.88	112.5M	824k	9h 43m	470	52

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.0322	$488.14	454.2M	2.3M	19h 33m	1703	83
2	Grok 4.6	0.0025	$162.38	158.0M	937k	10h 27m	649	14
3	Grok 4.6	0.0012	$313.02	296.5M	1.9M	18h 41m	1120	19
4	Grok 4.6	0.0007	$96.00	91.3M	481k	3h 53m	329	3
5	Grok 4.6	0.0000	$419.76	405.9M	2.2M	19h 4m	1586	60

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.3824	$105.13	105.0M	1.0M	6h 34m	490	2
2	Grok 4.6	0.0000	$114.14	110.5M	1.1M	7h 47m	492	4
3	Grok 4.6	0.0000	$407.54	406.7M	2.0M	19h 47m	1527	137
4	Grok 4.6	0.0000	$250.10	240.1M	1.8M	13h 13m	970	43
5	Grok 4.6	0.0000	$233.84	217.8M	2.5M	19h 53m	929	30

libexpat Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.1479	$150.76	148.7M	804k	4h 11m	580	26
2	Grok 4.6	0.1393	$108.10	108.1M	736k	4h 5m	435	11
3	Grok 4.6	0.1022	$79.42	75.8M	516k	2h 56m	273	7
4	Grok 4.6	0.0000	$93.77	99.5M	677k	3h 26m	435	10
5	Grok 4.6	0.0000	$71.78	70.3M	399k	1h 58m	277	5

Lua Native Compiler

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.6384	$176.45	167.1M	1.5M	7h 26m	653	8
2	Grok 4.6	0.0000	$110.36	107.0M	986k	5h 11m	447	8
3	Grok 4.6	0.0000	$271.55	264.4M	2.0M	9h 49m	1061	31
4	Grok 4.6	0.0000	$676.54	663.0M	4.1M	19h 59m	2429	277
5	Grok 4.6	0.0000	$250.76	240.6M	2.1M	11h 13m	930	16

Machine-Learned Interatomic Potential

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.8964	$27.94	18.3M	258k	19h 42m	147	2
2	Grok 4.6	0.8799	$71.42	58.5M	227k	19h 56m	307	9
3	Grok 4.6	0.8342	$80.88	55.9M	251k	19h 37m	265	10
4	Grok 4.6	0.7267	$28.23	20.6M	259k	19h 44m	159	3
5	Grok 4.6	0.5686	$61.59	46.3M	291k	18h 29m	250	4

Medium-Range Weather Forecast

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.5804	$120.40	104.0M	444k	19h 13m	464	37
2	Grok 4.6	0.5522	$208.02	184.0M	911k	19h 55m	826	53
3	Grok 4.6	0.5495	$238.57	230.6M	626k	20h 0m	861	62
4	Grok 4.6	0.4530	$43.07	35.9M	245k	19h 35m	225	1
5	Grok 4.6	0.4154	$92.48	66.7M	263k	19h 27m	303	6

MEG Speech Decoding

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.3041	$128.46	122.4M	984k	15h 5m	545	23
2	Grok 4.6	0.2265	$217.69	204.9M	1.2M	19h 25m	878	23
3	Grok 4.6	0.2107	$132.86	129.3M	708k	19h 25m	571	33
4	Grok 4.6	0.1844	$95.16	83.3M	284k	18h 58m	362	11
5	Grok 4.6	0.1245	$71.38	67.2M	365k	9h 53m	293	10

Wan 2.1 on MAX/Mojo

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.9085	$149.23	138.7M	1.3M	12h 2m	586	2
2	Grok 4.6	0.9047	$29.23	30.9M	270k	3h 12m	158	1
3	Grok 4.6	0.9010	$76.51	66.4M	639k	9h 42m	273	2
4	Grok 4.6	0.2716	$127.41	108.5M	1.7M	19h 30m	464	4
5	Grok 4.6	0.2296	$214.90	198.0M	1.7M	19h 41m	759	13

MS/MS De Novo Generation

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.1023	$289.71	280.9M	1.3M	20h 0m	1109	91
2	Grok 4.6	0.0709	$86.33	77.3M	437k	10h 44m	317	6
3	Grok 4.6	0.0000	$51.24	39.8M	426k	15h 47m	243	5
4	Grok 4.6	0.0000	$192.75	185.2M	1.2M	14h 10m	766	64
5	Grok 4.6	0.0000	$86.81	76.6M	468k	16h 53m	336	9

Multi-GPU Efficient Finetuning

task page →5 runs · indexed 2026-09-02

#	Model	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	$47.03	50.4M	373k	19h 22m	261	13
2	Grok 4.6	$18.53	24.3M	327k	17h 14m	194	7
3	Grok 4.6	$32.88	28.8M	249k	18h 12m	196	5
4	Grok 4.6	$23.95	18.0M	271k	19h 15m	145	4
5	Grok 4.6	$20.07	18.4M	217k	18h 24m	156	8

Notebook Compression

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.2286	$85.31	84.1M	498k	7h 48m	331	14
2	Grok 4.6	0.2146	$36.98	34.6M	412k	13h 20m	220	5
3	Grok 4.6	0.2098	$96.38	88.3M	636k	11h 39m	377	12
4	Grok 4.6	0.2060	$71.54	75.2M	388k	6h 34m	381	27
5	Grok 4.6	0.2019	$87.92	83.6M	470k	8h 37m	361	10

Flight-Sim Renderer in OpenGL

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.0526	$317.62	274.4M	1.8M	19h 55m	1078	110
2	Grok 4.6	0.0382	$286.38	260.8M	1.4M	19h 57m	984	103
3	Grok 4.6	0.0273	$488.84	437.7M	2.0M	19h 56m	1536	307
4	Grok 4.6	0.0266	$454.46	403.4M	2.0M	19h 58m	1435	75
5	Grok 4.6	0.0147	$328.36	283.8M	1.8M	19h 57m	1084	57

Optimizer Design

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.2557	$99.14	98.0M	624k	19h 20m	424	18
2	Grok 4.6	0.1957	$53.90	66.7M	503k	19h 24m	395	24
3	Grok 4.6	0.1570	$59.53	57.5M	295k	19h 26m	258	11
4	Grok 4.6	0.1368	$54.49	49.3M	462k	19h 16m	240	10
5	Grok 4.6	0.0839	$80.45	75.7M	333k	19h 42m	279	3

PostgreSQL 18 on SQLite

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.1593	$509.89	496.5M	1.6M	19h 56m	1696	70
2	Grok 4.6	0.1538	$461.37	465.7M	1.9M	17h 59m	1842	49
3	Grok 4.6	0.0989	$257.56	255.7M	1.5M	8h 44m	952	17
4	Grok 4.6	0.0714	$398.74	383.4M	2.7M	19h 51m	1457	34
5	Grok 4.6	0.0495	$148.44	141.0M	985k	6h 17m	559	10

Quantum ESPRESSO pw.x in Rust

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.3984	$196.95	181.0M	1.6M	13h 51m	681	14
2	Grok 4.6	0.3008	$282.67	273.1M	1.6M	13h 49m	976	40
3	Grok 4.6	0.2683	$1211.08	1191.6M	2.2M	19h 59m	3559	243
4	Grok 4.6	0.1057	$123.16	111.5M	1.7M	10h 28m	429	13
5	Grok 4.6	0.0976	$96.14	88.3M	1.1M	7h 19m	360	12

Qubit Routing

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.7350	$123.13	116.9M	502k	9h 53m	414	28
2	Grok 4.6	0.6883	$68.03	60.3M	544k	3h 28m	249	6
3	Grok 4.6	0.6689	$82.90	75.9M	477k	3h 6m	283	17
4	Grok 4.6	0.6619	$46.47	48.9M	429k	4h 33m	274	7
5	Grok 4.6	0.5924	$84.01	82.0M	496k	4h 20m	336	10

Reconnaissance Blind Chess Recovery

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.6036	$87.29	70.2M	604k	8h 33m	259	9
2	Grok 4.6	0.5857	$104.51	99.3M	819k	14h 17m	453	24
3	Grok 4.6	0.4071	$107.37	99.7M	852k	13h 36m	443	17
4	Grok 4.6	0.2786	$78.34	65.1M	979k	10h 29m	301	8
5	Grok 4.6	0.0929	$172.71	159.1M	1.1M	14h 32m	609	14

Fitness-Recap Video in Remotion

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.0338	$1762.94	1204.0M	2.8M	20h 0m	4175	289
2	Grok 4.6	0.0279	$646.10	557.5M	1.5M	19h 48m	2043	149
3	Grok 4.6	0.0245	$555.19	490.3M	1.5M	19h 56m	2020	90
4	Grok 4.6	0.0242	$1149.83	792.5M	1.8M	19h 58m	2836	250
5	Grok 4.6	0.0216	$746.94	531.5M	1.4M	19h 55m	1941	163

Snooker Prediction

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.3789	$466.11	391.2M	2.0M	19h 43m	1488	73
2	Grok 4.6	0.3048	$106.12	86.0M	725k	5h 58m	378	5
3	Grok 4.6	0.1779	$108.45	87.9M	851k	6h 23m	344	15
4	Grok 4.6	0.1175	$125.27	104.6M	768k	11h 27m	446	9
5	Grok 4.6	0.0252	$77.16	60.3M	816k	4h 29m	271	13

SPICE Circuit Simulator in Rust

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.5657	$717.25	714.4M	2.7M	18h 22m	2483	266
2	Grok 4.6	0.5253	$835.65	836.5M	3.1M	20h 0m	3128	205
3	Grok 4.6	0.4848	$586.10	582.0M	3.0M	17h 34m	2322	89
4	Grok 4.6	0.4646	$1191.20	1187.2M	2.5M	19h 58m	3879	96
5	Grok 4.6	0.4545	$165.93	154.1M	860k	5h 37m	563	37

Synthetic Music Diarization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.4661	$133.75	133.0M	655k	19h 52m	578	42
2	Grok 4.6	0.4323	$188.19	192.5M	1.1M	19h 45m	871	56
3	Grok 4.6	0.4120	$228.84	232.3M	993k	19h 44m	918	63
4	Grok 4.6	0.3985	$299.53	304.5M	1.6M	19h 27m	1281	54
5	Grok 4.6	0.0000	$501.54	509.4M	1.9M	18h 17m	1937	96

Vision-only TORCS Racing Bot

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.1206	$114.81	93.3M	882k	19h 41m	426	10
2	Grok 4.6	0.0335	$207.50	166.7M	1.1M	18h 40m	692	23
3	Grok 4.6	0.0122	$159.04	128.5M	975k	18h 46m	569	20
4	Grok 4.6	0.0043	$218.28	183.9M	1.3M	14h 37m	752	15
5	Grok 4.6	0.0000†	$57.50	52.5M	468k	7h 59m	252	3

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.

Verilog Simulator in Swift

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Grok 4.6	0.8253	$223.65	211.2M	1.9M	12h 53m	884	31
2	Grok 4.6	0.8116	$347.28	325.2M	2.2M	19h 55m	1222	56
3	Grok 4.6	0.7517	$518.10	508.9M	2.5M	19h 53m	1842	50
4	Grok 4.6	0.6901	$168.65	160.9M	1.6M	9h 35m	691	25
5	Grok 4.6	0.5188	$107.03	99.0M	943k	6h 25m	402	19