Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Kolmogorov Audio Compression

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.0779	$45.19	77.6M	262k	17h 49m	334	16
2	Claude Fable 5.1	0.0754	$52.35	88.6M	331k	12h 35m	339	10
3	Claude Fable 5.1	0.0711	$71.87	125.0M	385k	17h 43m	414	18
4	Claude Fable 5.1	0.0695	$54.46	93.0M	327k	16h 46m	347	11
5	Claude Fable 5.1	0.0678	$47.98	81.1M	304k	16h 17m	333	10

Astronomy Toolkit

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.8953	$64.06	109.1M	391k	4h 49m	305	17
2	Claude Fable 5.1	0.8935	$57.22	97.5M	350k	6h 25m	298	24
3	Claude Fable 5.1	0.8000	$36.76	59.7M	285k	3h 53m	220	11
4	Claude Fable 5.1	0.7999	$32.01	51.0M	267k	3h 57m	202	12
5	Claude Fable 5.1	0.7955	$42.10	68.8M	317k	4h 11m	232	12

Cranelift Codegen Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.3484	$166.03	303.2M	604k	16h 29m	825	13
2	Claude Fable 5.1	0.3356	$233.87	425.4M	876k	16h 37m	1021	18
3	Claude Fable 5.1	0.2852	$199.91	365.0M	723k	15h 17m	974	15
4	Claude Fable 5.1	0.2009	$170.71	311.4M	625k	17h 11m	813	17
5	Claude Fable 5.1	0.0000	$232.11	427.5M	765k	16h 0m	1023	35

Dart Style in Haskell

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9491	$569.86	1069.9M	1.4M	17h 10m	2285	28
2	Claude Fable 5.1	0.9284	$552.06	1031.1M	1.5M	18h 56m	2091	46
3	Claude Fable 5.1	0.9275	$456.14	848.4M	1.3M	18h 57m	2026	39
4	Claude Fable 5.1	0.8919	$415.43	774.8M	1.2M	19h 19m	1796	47
5	Claude Fable 5.1	0.8712	$313.43	577.0M	1.0M	18h 15m	1283	12

FFmpeg libswscale Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.8080	$283.04	487.0M	1.6M	13h 9m	1070	46
2	Claude Fable 5.1	0.5509	$202.06	343.4M	1.3M	9h 13m	819	28
3	Claude Fable 5.1	0.5106	$148.93	254.0M	906k	6h 11m	641	18
4	Claude Fable 5.1	0.1368	$219.11	385.2M	1.1M	10h 27m	835	22
5	Claude Fable 5.1	0.0000	$217.24	363.8M	1.5M	10h 22m	893	27

Crash-Proof Flash Filesystem

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9970	$49.34	77.1M	443k	2h 57m	208	6
2	Claude Fable 5.1	0.9927	$43.72	70.9M	340k	3h 17m	229	4
3	Claude Fable 5.1	0.9927	$61.85	100.4M	479k	3h 5m	243	10
4	Claude Fable 5.1	0.8898	$81.53	137.5M	526k	5h 0m	326	10
5	Claude Fable 5.1	0.0173	$56.44	90.9M	453k	4h 18m	228	8

FrogsGame Post-Training

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9740	$14.41	21.9M	144k	17h 0m	153	5
2	Claude Fable 5.1	0.8920	$12.71	19.5M	122k	16h 12m	146	4
3	Claude Fable 5.1	0.7800	$16.40	25.5M	151k	15h 15m	165	3
4	Claude Fable 5.1	0.6180	$15.24	23.4M	145k	17h 43m	162	6
5	Claude Fable 5.1	0.4080	$13.04	19.3M	141k	15h 46m	135	4

Stepper Music Sequencer GBA

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9662	$443.40	798.0M	1.8M	18h 14m	1802	27
2	Claude Fable 5.1	0.9569	$440.73	799.7M	1.7M	15h 10m	1825	14
3	Claude Fable 5.1	0.9473	$365.73	654.8M	1.6M	15h 4m	1521	20
4	Claude Fable 5.1	0.9459	$457.39	831.4M	1.7M	14h 37m	1849	32
5	Claude Fable 5.1	0.9053	$549.23	1015.6M	1.7M	16h 2m	2234	18

Git to Zig

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.5599	$663.30	1199.7M	2.6M	18h 57m	2674	17
2	Claude Fable 5.1	0.5146	$566.08	1019.0M	2.3M	19h 11m	2360	13
3	Claude Fable 5.1	0.5049	$432.88	762.8M	2.1M	18h 58m	1732	13
4	Claude Fable 5.1	0.4886	$363.29	631.2M	2.0M	18h 58m	1562	11
5	Claude Fable 5.1	0.4844	$390.64	686.7M	2.0M	19h 13m	1611	26

Granite Mamba2 Inference Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.8458	$138.31	228.0M	1000k	9h 1m	580	15
2	Claude Fable 5.1	0.8393	$189.96	320.0M	1.2M	8h 30m	718	28
3	Claude Fable 5.1	0.8171	$168.52	281.0M	1.2M	8h 8m	667	16
4	Claude Fable 5.1	0.8047	$204.26	349.5M	1.2M	8h 27m	784	31
5	Claude Fable 5.1	0.7867	$157.78	258.9M	1.2M	7h 40m	582	11

Higgs Uncertainty Inference

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9930	$40.59	65.5M	322k	8h 40m	241	9
2	Claude Fable 5.1	0.9895	$33.56	52.1M	309k	8h 2m	221	8
3	Claude Fable 5.1	0.3345	$30.45	45.8M	311k	4h 14m	174	15
4	Claude Fable 5.1	0.2017	$30.51	47.2M	284k	6h 48m	194	9
5	Claude Fable 5.1	0.0778	$29.88	44.4M	316k	2h 48m	183	13

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	$219.62	392.8M	963k	7h 58m	844	9
2	Claude Fable 5.1	$193.70	342.2M	936k	9h 59m	820	11
3	Claude Fable 5.1	$177.26	316.2M	794k	11h 11m	833	9
4	Claude Fable 5.1	$182.53	329.2M	746k	9h 31m	841	21
5	Claude Fable 5.1	$226.14	406.3M	953k	11h 14m	902	15

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	1.0000	$34.17	49.9M	378k	2h 37m	164	6
2	Claude Fable 5.1	1.0000	$45.30	70.2M	418k	4h 0m	200	9
3	Claude Fable 5.1	1.0000	$34.22	50.9M	360k	1h 59m	159	8
4	Claude Fable 5.1	1.0000	$43.08	67.7M	379k	4h 3m	206	11
5	Claude Fable 5.1	1.0000	$50.91	83.1M	385k	3h 9m	232	8

libexpat Optimization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.5674	$350.25	628.4M	1.5M	16h 3m	1456	82
2	Claude Fable 5.1	0.5395	$313.80	554.2M	1.5M	11h 26m	1289	34
3	Claude Fable 5.1	0.4885	$375.68	676.2M	1.5M	17h 3m	1505	50
4	Claude Fable 5.1	0.4469	$289.07	503.7M	1.5M	13h 41m	1156	50
5	Claude Fable 5.1	0.2880	$179.04	308.9M	1.0M	10h 29m	755	12

Lua Native Compiler

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	1.0000	$44.19	69.8M	381k	3h 24m	215	8
2	Claude Fable 5.1	1.0000	$51.03	82.5M	402k	3h 56m	245	12
3	Claude Fable 5.1	1.0000	$55.84	88.8M	470k	3h 14m	235	6
4	Claude Fable 5.1	0.8463	$43.78	69.0M	381k	3h 39m	231	1
5	Claude Fable 5.1	0.6667	$57.38	92.1M	466k	4h 40m	248	7

Machine-Learned Interatomic Potential

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9586	$14.22	21.7M	140k	16h 34m	179	11
2	Claude Fable 5.1	0.9369	$12.11	18.4M	119k	17h 11m	175	15
3	Claude Fable 5.1	0.9113	$11.26	16.5M	124k	17h 50m	150	5
4	Claude Fable 5.1	0.8820	$17.05	26.5M	157k	16h 32m	179	7
5	Claude Fable 5.1	0.8229	$11.99	18.2M	119k	18h 9m	171	13

Medium-Range Weather Forecast

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.6214	$15.11	24.2M	125k	16h 58m	204	11
2	Claude Fable 5.1	0.6178	$12.69	20.4M	104k	18h 1m	175	12
3	Claude Fable 5.1	0.6011	$16.81	27.4M	129k	16h 5m	208	16
4	Claude Fable 5.1	0.5960	$16.06	25.6M	135k	16h 36m	193	12
5	Claude Fable 5.1	0.0000	$14.60	23.4M	121k	14h 28m	186	8

MEG Speech Decoding

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.3166	$19.44	30.2M	179k	16h 28m	214	8
2	Claude Fable 5.1	0.3123	$26.35	42.8M	204k	16h 51m	240	12
3	Claude Fable 5.1	0.3116	$13.99	21.5M	133k	17h 11m	192	11
4	Claude Fable 5.1	0.3057	$16.57	26.2M	144k	13h 23m	202	11
5	Claude Fable 5.1	0.2155	$25.98	41.7M	212k	14h 56m	237	10

Wan 2.1 on MAX/Mojo

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9331	$62.26	106.8M	367k	8h 14m	284	8
2	Claude Fable 5.1	0.9314	$52.87	90.3M	319k	5h 49m	274	9
3	Claude Fable 5.1	0.9205	$68.80	118.8M	390k	9h 16m	323	6
4	Claude Fable 5.1	0.9192	$42.87	72.2M	281k	5h 13m	226	5
5	Claude Fable 5.1	0.9186	$55.53	95.2M	329k	8h 32m	279	10

Multi-GPU Efficient Finetuning

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.2857	$5.65	7.6M	75k	17h 4m	98	2
2	Claude Fable 5.1	0.2857	$5.38	7.9M	60k	16h 16m	118	3
3	Claude Fable 5.1	0.2619	$6.12	8.6M	75k	18h 44m	112	4
4	Claude Fable 5.1	0.2143	$5.26	7.1M	71k	18h 19m	92	3
5	Claude Fable 5.1	0.1667	$6.92	9.6M	88k	17h 1m	101	4

Notebook Compression

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.6002	$67.85	117.2M	379k	14h 26m	401	17
2	Claude Fable 5.1	0.5736	$77.68	134.5M	428k	13h 49m	450	16
3	Claude Fable 5.1	0.5457	$68.00	118.2M	365k	13h 15m	419	21
4	Claude Fable 5.1	0.5279	$64.70	113.1M	334k	17h 24m	419	17
5	Claude Fable 5.1	0.4824	$61.77	107.1M	338k	15h 49m	418	16

Flight-Sim Renderer in OpenGL

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.4716	$208.91	376.5M	866k	17h 50m	1017	10
2	Claude Fable 5.1	0.3532	$168.41	314.0M	539k	12h 53m	608	4
3	Claude Fable 5.1	0.3481	$106.70	193.6M	429k	9h 8m	454	13
4	Claude Fable 5.1	0.3402	$125.75	229.9M	473k	10h 25m	482	6
5	Claude Fable 5.1	0.1985	$113.40	205.2M	463k	5h 28m	430	3

Optimizer Design

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.2272	$15.45	22.4M	175k	11h 13m	164	5
2	Claude Fable 5.1	0.1750	$17.15	26.3M	165k	12h 46m	182	6
3	Claude Fable 5.1	0.1459	$14.90	22.4M	152k	15h 9m	171	4
4	Claude Fable 5.1	0.1343	$11.08	15.3M	141k	13h 28m	134	3
5	Claude Fable 5.1	0.0226	$15.74	21.7M	202k	14h 5m	141	4

PostgreSQL 18 on SQLite

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.4011	$588.09	1056.3M	2.5M	17h 46m	2515	13
2	Claude Fable 5.1	0.3901	$721.01	1319.3M	2.5M	17h 44m	2872	14
3	Claude Fable 5.1	0.3516	$384.99	680.6M	1.8M	18h 59m	1688	9
4	Claude Fable 5.1	0.3352	$475.86	850.2M	2.1M	18h 4m	1894	7
5	Claude Fable 5.1	0.2308	$392.90	697.7M	1.8M	19h 16m	1679	4

Quantum ESPRESSO pw.x in Rust

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9431	$100.68	158.8M	876k	5h 35m	408	11
2	Claude Fable 5.1	0.9350	$63.80	99.1M	584k	3h 4m	218	8
3	Claude Fable 5.1	0.9268	$63.95	99.7M	578k	3h 23m	222	5
4	Claude Fable 5.1	0.9187	$72.59	116.9M	580k	4h 7m	245	5
5	Claude Fable 5.1	0.9106	$77.90	124.4M	643k	3h 55m	256	4

Qubit Routing

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.8857	$37.59	60.9M	295k	9h 18m	239	6
2	Claude Fable 5.1	0.8752	$40.65	67.2M	290k	7h 39m	274	9
3	Claude Fable 5.1	0.8680	$40.94	67.5M	295k	10h 23m	279	9
4	Claude Fable 5.1	0.8599	$41.23	67.7M	303k	9h 29m	256	9
5	Claude Fable 5.1	0.8541	$59.53	101.1M	368k	11h 5m	353	7

Reconnaissance Blind Chess Recovery

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9536	$56.70	98.3M	311k	9h 23m	314	7
2	Claude Fable 5.1	0.9536	$46.08	78.9M	273k	10h 59m	276	9
3	Claude Fable 5.1	0.9429	$31.38	51.1M	239k	11h 53m	233	6
4	Claude Fable 5.1	0.8357	$41.84	71.9M	245k	9h 32m	252	11
5	Claude Fable 5.1	0.7929	$38.22	64.0M	257k	7h 37m	245	4

Fitness-Recap Video in Remotion

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.2055	$157.69	293.5M	491k	6h 51m	665	8
2	Claude Fable 5.1	0.2018	$157.38	293.1M	476k	6h 7m	644	7
3	Claude Fable 5.1	0.1927	$120.12	223.7M	414k	5h 14m	587	7
4	Claude Fable 5.1	0.1730	$560.60	1048.2M	1.5M	18h 2m	2274	26
5	Claude Fable 5.1	0.0694	$335.29	627.1M	960k	15h 45m	1456	19

Snooker Prediction

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.5126	$87.17	154.8M	404k	6h 52m	408	12
2	Claude Fable 5.1	0.4984	$96.24	173.0M	403k	7h 34m	486	21
3	Claude Fable 5.1	0.4822	$86.06	152.3M	409k	8h 44m	402	23
4	Claude Fable 5.1	0.4767	$88.31	156.7M	413k	3h 39m	397	10
5	Claude Fable 5.1	0.3738	$86.02	153.2M	388k	5h 28m	424	9

SPICE Circuit Simulator in Rust

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.8586	$166.41	276.3M	1.2M	9h 57m	632	17
2	Claude Fable 5.1	0.7677	$93.05	145.4M	837k	3h 54m	417	4
3	Claude Fable 5.1	0.7071	$96.79	153.4M	827k	4h 2m	413	8
4	Claude Fable 5.1	0.6970	$69.08	107.8M	623k	2h 37m	227	2
5	Claude Fable 5.1	0.6667	$96.05	148.5M	898k	4h 16m	406	6

Synthetic Music Diarization

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.5457	$12.11	18.5M	118k	17h 49m	156	8
2	Claude Fable 5.1	0.5346	$11.41	17.0M	120k	17h 44m	158	7
3	Claude Fable 5.1	0.5104	$17.60	28.7M	134k	17h 45m	230	11
4	Claude Fable 5.1	0.4905	$10.29	15.1M	114k	17h 40m	140	7
5	Claude Fable 5.1	0.4889	$10.86	15.6M	125k	15h 34m	138	6

Vision-only TORCS Racing Bot

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.3604	$65.32	119.8M	246k	14h 32m	399	16
2	Claude Fable 5.1	0.3524	$77.13	147.0M	311k	14h 51m	472	5
3	Claude Fable 5.1	0.2715	$77.56	137.7M	370k	10h 32m	426	7
4	Claude Fable 5.1	0.2491	$104.18	191.5M	350k	15h 56m	562	8
5	Claude Fable 5.1	0.1812	$69.87	126.5M	304k	15h 13m	418	9

Verilog Simulator in Swift

task page →5 runs · indexed 2026-09-02

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Claude Fable 5.1	0.9332	$262.30	478.6M	947k	9h 23m	1148	17
2	Claude Fable 5.1	0.9315	$216.99	391.4M	878k	7h 55m	966	6
3	Claude Fable 5.1	0.9195	$211.66	382.5M	840k	9h 40m	989	17
4	Claude Fable 5.1	0.9161	$266.36	483.7M	1.0M	10h 14m	1167	34
5	Claude Fable 5.1	0.9092	$168.96	308.4M	606k	6h 47m	586	10