Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Kolmogorov Audio Compression

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	1.0000	$2526.29	1186.0M	2.6M	19h 52m	2748	60
2	GPT-6 Astra	1.0000	$2608.33	1211.7M	2.6M	19h 14m	2577	57
3	GPT-6 Astra	1.0000	$2728.80	1295.7M	2.6M	19h 47m	2920	59
4	GPT-6 Astra	1.0000	$1955.97	919.3M	1.8M	13h 34m	2031	27
5	GPT-6 Astra	0.0696	$683.33	329.9M	756k	19h 26m	879	16

Astronomy Toolkit

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.8045	$135.65	67.7M	278k	2h 40m	277	5
2	GPT-6 Astra	0.7969	$2365.47	1121.6M	2.3M	19h 43m	2548	49
3	GPT-6 Astra	0.7058	$233.15	111.6M	353k	2h 41m	356	10
4	GPT-6 Astra	0.7013	$86.82	45.8M	224k	2h 2m	214	5
5	GPT-6 Astra	0.6917	$365.75	173.3M	402k	3h 17m	457	7

Cranelift Codegen Optimization

task page →4 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.3006	$2589.93	1231.7M	1.9M	19h 38m	2587	122
2	GPT-6 Astra	0.2357	$2732.07	1287.7M	2.4M	19h 34m	2829	97
3	GPT-6 Astra	0.2194	$2585.69	1232.6M	2.0M	18h 22m	2643	79
4	GPT-6 Astra	0.1650	$2812.60	1334.7M	2.3M	19h 56m	2934	92

Dart Style in Haskell

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9601	$2439.09	1157.2M	2.2M	16h 56m	2671	30
2	GPT-6 Astra	0.9508	$2034.34	972.8M	1.7M	15h 13m	2216	42
3	GPT-6 Astra	0.9472	$895.41	422.2M	827k	6h 22m	958	14
4	GPT-6 Astra	0.9426	$2766.39	1322.7M	2.4M	19h 53m	2984	74
5	GPT-6 Astra	0.8965	$171.46	81.1M	258k	2h 1m	277	7

FFmpeg libswscale Optimization

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.2755	$169.85	82.4M	307k	2h 7m	290	7
2	GPT-6 Astra	0.2021	$313.12	153.5M	377k	2h 54m	458	9
3	GPT-6 Astra	0.1983	$306.45	149.1M	351k	2h 48m	444	8
4	GPT-6 Astra	0.1741	$262.36	125.2M	349k	2h 37m	379	6
5	GPT-6 Astra	0.1179	$275.12	132.2M	355k	2h 35m	396	6

Crash-Proof Flash Filesystem

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.6090	$92.20	45.6M	190k	1h 44m	177	4
2	GPT-6 Astra	0.5968	$497.70	237.1M	397k	4h 16m	516	14
3	GPT-6 Astra	0.5902	$154.84	75.5M	253k	1h 42m	259	5
4	GPT-6 Astra	0.5835	$114.98	55.8M	198k	1h 55m	208	5
5	GPT-6 Astra	0.5519	$228.77	111.2M	286k	2h 11m	332	5

FrogsGame Post-Training

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9700	$116.67	60.2M	205k	18h 38m	255	8
2	GPT-6 Astra	0.9160	$256.74	124.3M	279k	19h 10m	365	11
3	GPT-6 Astra	0.9000	$49.97	27.6M	160k	19h 17m	158	6
4	GPT-6 Astra	0.8840	$265.88	128.3M	310k	19h 14m	390	8
5	GPT-6 Astra	0.6760	$444.71	214.4M	392k	19h 40m	521	10

Stepper Music Sequencer GBA

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9974	$3129.48	1515.4M	2.4M	19h 55m	3376	49
2	GPT-6 Astra	0.9897	$2759.22	1308.1M	2.5M	19h 59m	2942	38
3	GPT-6 Astra	0.9861	$2721.06	1296.9M	2.6M	19h 56m	2978	26
4	GPT-6 Astra	0.9793	$2755.43	1303.4M	2.5M	19h 59m	2916	37
5	GPT-6 Astra	0.9655	$2773.42	1319.2M	2.5M	19h 57m	2941	30

Git to Zig

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9864	$3111.97	1407.9M	3.4M	19h 58m	3119	48
2	GPT-6 Astra	0.9049	$3006.21	1380.7M	3.3M	20h 0m	3129	60
3	GPT-6 Astra	0.8950	$2950.79	1350.4M	3.3M	19h 50m	3031	52
4	GPT-6 Astra	0.8938	$3057.89	1408.3M	3.3M	19h 59m	3204	96
5	GPT-6 Astra	0.8893	$3214.36	1493.6M	3.2M	19h 59m	3347	99

Granite Mamba2 Inference Optimization

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.8707	$2626.81	1259.5M	2.3M	18h 25m	2839	58
2	GPT-6 Astra	0.8658	$272.49	128.6M	369k	2h 40m	367	7
3	GPT-6 Astra	0.8334	$251.26	124.6M	331k	2h 35m	409	4
4	GPT-6 Astra	0.8266	$344.95	163.8M	406k	3h 8m	459	8
5	GPT-6 Astra	0.8198	$254.82	122.3M	354k	2h 28m	374	7

Higgs Uncertainty Inference

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	1.0000	$164.97	80.6M	296k	2h 47m	306	8
2	GPT-6 Astra	1.0000	$50.75	31.1M	211k	1h 50m	184	6
3	GPT-6 Astra	0.9768	$52.93	33.2M	214k	1h 55m	200	5
4	GPT-6 Astra	0.4310	$132.03	68.3M	275k	2h 40m	289	5
5	GPT-6 Astra	0.2020	$84.84	43.9M	239k	1h 53m	208	6

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.5349	$1954.03	921.6M	1.6M	19h 56m	1932	31
2	GPT-6 Astra	0.0000	$2665.44	1249.7M	2.4M	19h 33m	2699	42
3	GPT-6 Astra	0.0000	$2441.52	1153.7M	2.1M	19h 6m	2553	41
4	GPT-6 Astra	0.0000	$2574.70	1208.7M	2.3M	17h 31m	2622	65
5	GPT-6 Astra	0.0000	$1722.33	819.7M	1.5M	19h 18m	1844	42

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9807	$122.08	64.3M	290k	2h 50m	282	4
2	GPT-6 Astra	0.9807	$62.98	37.7M	245k	1h 38m	203	5
3	GPT-6 Astra	0.9807	$123.05	61.8M	300k	2h 8m	260	3
4	GPT-6 Astra	0.9791	$34.15	22.2M	179k	1h 14m	133	3
5	GPT-6 Astra	0.9791	$174.62	85.4M	285k	2h 50m	311	4

libexpat Optimization

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.2941	$510.01	240.5M	518k	4h 1m	542	7
2	GPT-6 Astra	0.2776	$415.35	191.6M	517k	3h 32m	444	6
3	GPT-6 Astra	0.2744	$177.86	83.5M	336k	2h 10m	283	5
4	GPT-6 Astra	0.1534	$13.19	6.7M	92k	53m	62	4
5	GPT-6 Astra	0.1516	$19.33	10.3M	134k	38m	78	3

Lua Native Compiler

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	1.0000	$46.19	26.4M	213k	1h 23m	134	7
2	GPT-6 Astra	1.0000	$35.97	23.6M	186k	1h 21m	133	4
3	GPT-6 Astra	1.0000	$131.76	64.1M	279k	2h 36m	232	7
4	GPT-6 Astra	0.9976	$79.59	42.6M	240k	2h 8m	195	9
5	GPT-6 Astra	0.9976	$93.69	48.6M	237k	1h 56m	206	6

Machine-Learned Interatomic Potential

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9884	$148.01	72.8M	245k	17h 13m	283	8
2	GPT-6 Astra	0.9884	$97.13	52.7M	210k	16h 8m	257	6
3	GPT-6 Astra	0.9842	$127.33	65.0M	249k	17h 10m	287	7
4	GPT-6 Astra	0.9702	$43.87	26.5M	154k	17h 20m	152	9
5	GPT-6 Astra	0.9688	$90.01	51.8M	262k	15h 58m	286	7

Medium-Range Weather Forecast

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.6474	$297.67	145.6M	335k	19h 47m	441	14
2	GPT-6 Astra	0.6387	$27.55	17.3M	152k	18h 9m	135	12
3	GPT-6 Astra	0.6362	$98.77	53.1M	216k	17h 56m	257	14
4	GPT-6 Astra	0.6334	$244.67	123.1M	350k	18h 49m	445	13
5	GPT-6 Astra	0.0000	$488.12	238.0M	474k	17h 46m	610	16

MEG Speech Decoding

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.3919	$899.22	430.4M	993k	17h 31m	1064	15
2	GPT-6 Astra	0.3729	$274.60	132.9M	344k	8h 16m	411	13
3	GPT-6 Astra	0.3704	$154.28	76.5M	270k	4h 15m	297	9
4	GPT-6 Astra	0.3557	$452.78	217.0M	444k	15h 46m	527	14
5	GPT-6 Astra	0.3431	$526.36	253.0M	673k	17h 55m	694	20

Wan 2.1 on MAX/Mojo

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9623	$128.98	66.9M	202k	2h 32m	252	3
2	GPT-6 Astra	0.9217	$103.16	56.8M	189k	2h 7m	236	3
3	GPT-6 Astra	0.9173	$183.34	92.0M	226k	1h 45m	305	2
4	GPT-6 Astra	0.9153	$76.89	42.2M	156k	1h 3m	187	3
5	GPT-6 Astra	0.9128	$82.94	47.1M	162k	1h 37m	205	3

MS/MS De Novo Generation

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.1731	$851.54	402.0M	882k	16h 28m	928	15
2	GPT-6 Astra	0.1695	$1429.90	682.5M	1.4M	13h 9m	1631	15
3	GPT-6 Astra	0.1667	$818.15	390.6M	876k	18h 17m	988	21
4	GPT-6 Astra	0.1525	$440.96	211.9M	461k	8h 1m	546	7
5	GPT-6 Astra	0.1519	$408.97	200.1M	427k	5h 57m	574	5

Multi-GPU Efficient Finetuning

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.2143	$155.59	78.1M	233k	19h 27m	299	6
2	GPT-6 Astra	0.1905	$229.70	113.1M	288k	19h 53m	364	6
3	GPT-6 Astra	0.1905	$125.10	64.1M	212k	19h 30m	261	6
4	GPT-6 Astra	0.0714	$291.48	141.3M	320k	19h 38m	402	6
5	GPT-6 Astra	0.0000	$142.95	74.8M	253k	19h 46m	311	7

Notebook Compression

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.6122	$2035.40	958.4M	1.9M	17h 45m	2132	53
2	GPT-6 Astra	0.6063	$2124.53	1006.7M	2.1M	18h 49m	2308	42
3	GPT-6 Astra	0.5422	$1208.04	578.6M	1.3M	19h 17m	1389	24
4	GPT-6 Astra	0.4322	$274.97	132.6M	360k	5h 47m	407	7
5	GPT-6 Astra	0.4121	$327.78	158.4M	411k	6h 16m	482	10

Flight-Sim Renderer in OpenGL

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9965	$2541.33	1210.9M	2.5M	19h 50m	2830	27
2	GPT-6 Astra	0.9845	$2685.88	1278.3M	2.6M	20h 0m	2961	38
3	GPT-6 Astra	0.9844	$2735.71	1297.4M	2.6M	19h 42m	2884	29
4	GPT-6 Astra	0.9841	$2589.72	1228.2M	2.6M	19h 59m	2801	34
5	GPT-6 Astra	0.9841	$2728.19	1288.8M	2.7M	19h 57m	2941	47

Optimizer Design

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.3513	$198.61	101.4M	290k	17h 55m	381	5
2	GPT-6 Astra	0.1940	$334.17	159.8M	312k	18h 23m	412	7
3	GPT-6 Astra	0.1777	$89.95	48.3M	203k	19h 38m	244	10
4	GPT-6 Astra	0.0929	$278.29	132.5M	303k	16h 52m	378	7
5	GPT-6 Astra	0.0523	$53.35	35.6M	191k	19h 46m	218	6

PostgreSQL 18 on SQLite

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.7308	$2982.00	1383.4M	2.9M	19h 56m	3073	67
2	GPT-6 Astra	0.7143	$3132.52	1453.4M	2.8M	19h 51m	3140	44
3	GPT-6 Astra	0.6593	$3139.16	1477.1M	2.8M	19h 52m	3280	73
4	GPT-6 Astra	0.6484	$3119.08	1452.8M	2.8M	19h 56m	3108	62
5	GPT-6 Astra	0.6209	$3312.10	1548.3M	2.9M	20h 0m	3255	61

Quantum ESPRESSO pw.x in Rust

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9350	$571.91	270.6M	494k	3h 53m	570	4
2	GPT-6 Astra	0.9350	$540.43	256.4M	446k	3h 37m	544	4
3	GPT-6 Astra	0.8699	$378.55	179.5M	449k	3h 11m	459	5
4	GPT-6 Astra	0.8699	$279.05	132.3M	363k	2h 37m	372	4
5	GPT-6 Astra	0.8293	$299.55	142.9M	339k	2h 28m	402	4

Qubit Routing

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9207	$412.86	201.8M	473k	7h 46m	595	12
2	GPT-6 Astra	0.9186	$1381.68	662.3M	1.4M	17h 52m	1621	26
3	GPT-6 Astra	0.9168	$2130.53	1024.2M	1.9M	19h 50m	2384	45
4	GPT-6 Astra	0.9131	$2239.25	1067.1M	2.1M	19h 57m	2429	54
5	GPT-6 Astra	0.8800	$604.79	292.5M	576k	8h 29m	715	11

Reconnaissance Blind Chess Recovery

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9857	$244.69	120.7M	324k	13h 51m	408	10
2	GPT-6 Astra	0.9429	$571.36	274.8M	479k	10h 52m	637	7
3	GPT-6 Astra	0.8429	$330.64	163.8M	407k	12h 13m	526	9
4	GPT-6 Astra	0.8357	$771.41	367.5M	716k	14h 57m	903	12
5	GPT-6 Astra	0.7536	$12.03	4.8M	92k	34m	69	3

Fitness-Recap Video in Remotion

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.7901	$2673.96	1271.2M	2.5M	19h 58m	2991	31
2	GPT-6 Astra	0.7705	$2639.52	1259.7M	2.5M	19h 50m	2961	27
3	GPT-6 Astra	0.7148	$2733.41	1304.4M	2.5M	19h 53m	2977	29
4	GPT-6 Astra	0.6873	$2846.47	1353.6M	2.5M	19h 54m	3114	36
5	GPT-6 Astra	0.6437	$2584.51	1240.4M	2.4M	19h 47m	2920	23

Snooker Prediction

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.6319	$2653.82	1245.9M	2.6M	19h 52m	2769	39
2	GPT-6 Astra	0.6316	$2364.83	1112.0M	2.4M	19h 31m	2539	51
3	GPT-6 Astra	0.6308	$1877.69	889.9M	1.7M	16h 9m	1997	31
4	GPT-6 Astra	0.6304	$348.12	162.7M	418k	3h 11m	442	4
5	GPT-6 Astra	0.6223	$321.27	149.5M	395k	3h 5m	401	4

SPICE Circuit Simulator in Rust

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9091	$2887.40	1385.4M	2.5M	19h 50m	3121	180
2	GPT-6 Astra	0.8990	$347.32	164.1M	405k	2h 56m	414	7
3	GPT-6 Astra	0.8990	$599.18	284.8M	531k	4h 2m	616	7
4	GPT-6 Astra	0.8889	$677.88	324.1M	558k	4h 32m	694	7
5	GPT-6 Astra	0.8687	$172.72	83.5M	308k	2h 47m	288	4

Synthetic Music Diarization

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.5899	$503.76	243.1M	455k	15h 19m	591	11
2	GPT-6 Astra	0.5838	$329.84	157.1M	371k	18h 6m	426	13
3	GPT-6 Astra	0.5821	$102.57	50.4M	226k	17h 2m	214	8
4	GPT-6 Astra	0.5755	$313.33	152.4M	361k	17h 42m	459	12
5	GPT-6 Astra	0.5062	$228.20	112.0M	318k	15h 43m	379	15

Vision-only TORCS Racing Bot

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.4570	$770.42	373.2M	731k	19h 37m	1013	12
2	GPT-6 Astra	0.3866	$1781.91	865.7M	1.5M	19h 55m	2133	25
3	GPT-6 Astra	0.2803	$1564.06	755.2M	1.2M	19h 40m	1857	16
4	GPT-6 Astra	0.1048	$823.35	394.4M	766k	19h 59m	1018	14
5	GPT-6 Astra	0.0879	$1737.29	826.0M	1.5M	19h 53m	1937	16

Verilog Simulator in Swift

task page →5 runs · indexed 2026-09-22

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	GPT-6 Astra	0.9503	$104.53	49.0M	213k	1h 48m	187	5
2	GPT-6 Astra	0.9469	$329.41	155.6M	366k	2h 26m	409	26
3	GPT-6 Astra	0.9452	$47.73	26.0M	162k	1h 5m	130	3
4	GPT-6 Astra	0.9349	$94.85	44.6M	216k	1h 33m	174	6
5	GPT-6 Astra	0.9264	$71.95	36.3M	192k	1h 35m	162	6