Tasks Traces V1 Blog Changelog Contribute GitHub

Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Astronomy Toolkit

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.2056	$84.96	112.8M	364k	5h 13m	428	19
2	Muse Spark 1.3	0.1015	$57.05	70.7M	278k	5h 16m	361	11
3	Muse Spark 1.3	0.0976	$81.13	81.9M	258k	12h 38m	397	2
4	Muse Spark 1.3	0.0279	$94.74	98.7M	274k	19h 49m	426	38
5	Muse Spark 1.3	0.0028	$18.89	27.3M	239k	2h 57m	175	4

Cranelift Codegen Optimization

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.0231	$411.74	433.6M	529k	18h 32m	875	4
2	Muse Spark 1.3	0.0192	$411.77	452.6M	517k	18h 56m	944	8
3	Muse Spark 1.3	0.0168	$495.72	581.2M	737k	19h 59m	1530	3
4	Muse Spark 1.3	0.0000	$472.59	577.9M	275k	18h 58m	1276	12
5	Muse Spark 1.3	0.0000	$394.96	454.8M	322k	15h 45m	1021	12

Crash-Proof Flash Filesystem

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.0177	$523.70	619.4M	1.1M	20h 0m	1409	1
2	Muse Spark 1.3	0.0173	$532.50	628.8M	1.0M	20h 0m	1552	1
3	Muse Spark 1.3	0.0002	$572.11	638.9M	1.2M	19h 59m	1384	1
4	Muse Spark 1.3	0.0000	$486.57	544.5M	845k	19h 59m	1421	1
5	Muse Spark 1.3	0.0000	$536.44	601.3M	1.3M	19h 59m	1324	1

Dart Style in Haskell

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.5513	$525.73	756.2M	1.1M	19h 57m	1637	8
2	Muse Spark 1.3	0.5258	$522.21	631.2M	1.1M	19h 59m	1757	5
3	Muse Spark 1.3	0.5020	$463.61	501.9M	1.1M	19h 20m	1265	9
4	Muse Spark 1.3	0.3680	$506.26	577.2M	925k	19h 53m	1567	1
5	Muse Spark 1.3	0.0010	$582.91	707.6M	1.1M	19h 56m	1740	10

FFmpeg libswscale Optimization

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.1277	$499.70	617.7M	951k	19h 17m	1401	24
2	Muse Spark 1.3	0.1028	$438.57	557.6M	1.0M	16h 30m	1340	23
3	Muse Spark 1.3	0.1003	$186.76	239.3M	502k	7h 59m	559	14
4	Muse Spark 1.3	0.0996	$157.06	200.2M	465k	6h 34m	504	12
5	Muse Spark 1.3	0.0779	$279.58	336.6M	595k	9h 26m	688	17

Fitness-Recap Video in Remotion

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.1827	$179.29	1045.0M	1.1M	19h 56m	2290	8
2	Muse Spark 1.3	0.1338	$375.85	806.9M	1.0M	20h 0m	1927	3
3	Muse Spark 1.3	0.0362	$213.98	610.8M	874k	19h 50m	1636	3
4	Muse Spark 1.3	0.0269	$429.57	453.8M	790k	19h 52m	1245	2
5	Muse Spark 1.3	0.0263	$363.14	496.5M	863k	19h 59m	1337	1

Flight-Sim Renderer in OpenGL

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.1055	$206.91	689.2M	886k	10h 35m	1681	1
2	Muse Spark 1.3	0.0410	$299.15	649.2M	932k	19h 37m	1588	2
3	Muse Spark 1.3	0.0386	$233.75	628.1M	517k	18h 2m	1282	5
4	Muse Spark 1.3	0.0254	$147.68	673.6M	1.0M	19h 47m	1561	8
5	Muse Spark 1.3	0.0250	$351.72	511.0M	807k	19h 59m	1300	1

FrogsGame Post-Training

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.6080	$42.76	36.7M	222k	19h 41m	241	2
2	Muse Spark 1.3	0.1340	$12.49	16.7M	201k	19h 20m	179	3
3	Muse Spark 1.3	0.0580	$11.26	13.8M	164k	19h 42m	163	3
4	Muse Spark 1.3	0.0380	$29.75	31.6M	256k	19h 58m	261	1
5	Muse Spark 1.3	0.0320	$20.03	29.7M	151k	19h 22m	241	1

Git to Zig

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.1427	$402.31	656.1M	1.1M	18h 56m	1632	3
2	Muse Spark 1.3	0.1274	$518.45	593.9M	920k	19h 54m	1465	2
3	Muse Spark 1.3	0.1062	$484.87	561.8M	975k	20h 0m	1499	1
4	Muse Spark 1.3	0.1006	$482.98	557.2M	1.0M	20h 0m	1594	15
5	Muse Spark 1.3	0.0000	$641.52	782.0M	1.4M	19h 59m	1580	1

Granite Mamba2 Inference Optimization

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.8136	$31.62	38.2M	374k	3h 49m	186	5
2	Muse Spark 1.3	0.8036	$155.17	181.2M	487k	18h 42m	545	11
3	Muse Spark 1.3	0.7809	$183.67	203.2M	648k	10h 29m	557	11
4	Muse Spark 1.3	0.6457	$320.20	329.1M	590k	13h 47m	773	12
5	Muse Spark 1.3	0.6302	$29.92	88.8M	460k	3h 13m	325	9

Higgs Uncertainty Inference

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.8206	$37.73	59.2M	320k	3h 38m	300	12
2	Muse Spark 1.3	0.7474	$18.67	43.3M	220k	4h 23m	250	6
3	Muse Spark 1.3	0.3726	$625.66	665.8M	679k	19h 55m	1128	223
4	Muse Spark 1.3	0.3641	$40.72	52.7M	332k	3h 49m	257	8
5	Muse Spark 1.3	0.0300	$39.32	51.4M	265k	3h 54m	261	8

Kolmogorov Audio Compression

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.0247	$73.55	80.1M	351k	10h 48m	392	7
2	Muse Spark 1.3	0.0215	$70.26	70.8M	222k	11h 3m	366	12
3	Muse Spark 1.3	0.0200	$64.21	65.3M	198k	19h 54m	404	5
4	Muse Spark 1.3	0.0192	$39.49	134.3M	306k	19h 56m	568	3
5	Muse Spark 1.3	0.0124	$64.76	58.2M	224k	18h 13m	384	11

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.9776	$411.77	410.4M	713k	19h 52m	799	2
2	Muse Spark 1.3	0.7421	$154.98	818.9M	1.3M	19h 49m	1805	2
3	Muse Spark 1.3	0.5609	$411.55	416.2M	856k	19h 58m	959	1
4	Muse Spark 1.3	0.5029	$384.24	384.5M	940k	19h 50m	937	1
5	Muse Spark 1.3	0.3530	$389.61	408.6M	860k	19h 59m	1015	1

libexpat Optimization

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.0996	$565.41	641.8M	1.1M	19h 58m	1422	16
2	Muse Spark 1.3	0.0752	$635.38	703.6M	636k	19h 52m	1342	3
3	Muse Spark 1.3	0.0491	$376.25	2119.7M	1.7M	19h 47m	4639	144
4	Muse Spark 1.3	0.0092	$609.32	704.0M	1.1M	19h 57m	1497	2
5	Muse Spark 1.3	0.0000	$571.21	716.3M	974k	19h 59m	1683	2

Lua Native Compiler

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.9976	$451.94	515.6M	941k	16h 46m	1261	2
2	Muse Spark 1.3	0.4969	$541.57	625.6M	1.2M	20h 0m	1447	1
3	Muse Spark 1.3	0.4002	$540.38	602.2M	792k	20h 0m	1400	1
4	Muse Spark 1.3	0.0000†	$75.32	109.8M	406k	5h 42m	461	6
5	Muse Spark 1.3	0.0000	$637.70	724.8M	869k	20h 0m	1631	1

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.

Machine-Learned Interatomic Potential

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.9755	$18.59	16.6M	98k	19h 46m	219	3
2	Muse Spark 1.3	0.9671	$61.92	58.4M	240k	19h 36m	410	4
3	Muse Spark 1.3	0.9529	$5.47	10.6M	104k	19h 34m	177	2
4	Muse Spark 1.3	0.8349	$17.65	15.6M	188k	19h 8m	174	1
5	Muse Spark 1.3	0.2516	$58.45	51.9M	245k	19h 22m	357	5

Medium-Range Weather Forecast

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.4646	$17.40	32.8M	150k	19h 29m	250	11
2	Muse Spark 1.3	0.4252	$39.97	63.7M	234k	18h 47m	401	10
3	Muse Spark 1.3	0.4057	$47.03	41.9M	228k	13h 41m	311	11
4	Muse Spark 1.3	0.3909	$44.60	41.6M	175k	17h 28m	283	7
5	Muse Spark 1.3	0.3160	$38.63	81.9M	260k	18h 49m	434	13

MEG Speech Decoding

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.3657	$29.63	28.5M	123k	19h 14m	290	12
2	Muse Spark 1.3	0.1430	$33.98	30.2M	124k	18h 44m	278	4
3	Muse Spark 1.3	0.1334	$8.50	30.2M	106k	18h 10m	317	7
4	Muse Spark 1.3	0.1187	$59.14	56.9M	180k	14h 50m	367	3
5	Muse Spark 1.3	0.0000	$32.86	29.1M	146k	18h 59m	269	6

MS/MS De Novo Generation

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.1200	$62.04	57.0M	274k	16h 49m	329	3
2	Muse Spark 1.3	0.1131	$41.90	45.4M	252k	18h 50m	304	7
3	Muse Spark 1.3	0.1082	$55.03	49.7M	225k	19h 54m	361	1
4	Muse Spark 1.3	0.1039	$52.80	46.7M	249k	19h 50m	351	6
5	Muse Spark 1.3	0.0000	$54.25	46.3M	268k	18h 59m	310	2

Multi-GPU Efficient Finetuning

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.3095	$25.50	21.9M	121k	19h 28m	197	2
2	Muse Spark 1.3	0.1429	$16.18	14.5M	230k	20h 0m	159	1
3	Muse Spark 1.3	0.0000	$22.96	20.6M	169k	19h 58m	157	5
4	Muse Spark 1.3	0.0000	$12.91	12.2M	103k	19h 52m	142	1
5	Muse Spark 1.3	0.0000	$30.08	27.4M	216k	19h 49m	204	1

Notebook Compression

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.2729	$60.32	65.3M	317k	6h 41m	357	11
2	Muse Spark 1.3	0.2285	$27.01	79.4M	314k	19h 7m	407	8
3	Muse Spark 1.3	0.2112	$78.14	76.4M	260k	11h 8m	358	3
4	Muse Spark 1.3	0.1309	$65.04	67.7M	249k	11h 11m	371	6
5	Muse Spark 1.3	0.1170	$63.50	77.9M	313k	5h 49m	326	3

Optimizer Design

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.1949	$17.67	14.5M	143k	19h 59m	150	1
2	Muse Spark 1.3	0.1110	$29.21	25.7M	102k	19h 53m	307	2
3	Muse Spark 1.3	0.1023	$23.80	20.6M	126k	19h 41m	260	2
4	Muse Spark 1.3	0.0000	$14.04	11.9M	125k	19h 29m	179	1
5	Muse Spark 1.3	0.0000	$22.03	18.0M	123k	19h 58m	201	2

PostgreSQL 18 on SQLite

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.3407	$551.80	666.0M	898k	19h 58m	1714	4
2	Muse Spark 1.3	0.1099	$305.43	1604.1M	2.2M	20h 0m	3690	2
3	Muse Spark 1.3	0.0549	$522.84	598.7M	1.2M	20h 0m	1525	1
4	Muse Spark 1.3	0.0549	$518.76	603.9M	1.1M	19h 59m	1572	1
5	Muse Spark 1.3	0.0495	$525.95	562.0M	986k	20h 0m	1387	1

Quantum ESPRESSO pw.x in Rust

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.4228	$418.71	442.8M	1.1M	20h 0m	1119	1
2	Muse Spark 1.3	0.4228	$514.22	583.5M	1.3M	19h 59m	1415	1
3	Muse Spark 1.3	0.3577	$352.28	387.2M	1.4M	19h 43m	1153	3
4	Muse Spark 1.3	0.1463	$336.34	348.3M	1.1M	19h 35m	939	9
5	Muse Spark 1.3	0.0163	$435.17	464.8M	1.2M	19h 59m	1196	1

Qubit Routing

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.6821	$28.97	85.7M	430k	5h 33m	396	21
2	Muse Spark 1.3	0.6752	$165.04	162.2M	432k	18h 15m	706	25
3	Muse Spark 1.3	0.6538	$51.51	57.6M	507k	5h 41m	286	10
4	Muse Spark 1.3	0.6245	$65.15	69.0M	497k	6h 34m	381	13
5	Muse Spark 1.3	0.6205	$141.97	139.6M	348k	19h 5m	580	13

Reconnaissance Blind Chess Recovery

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.4500	$83.30	135.3M	1.0M	14h 48m	459	4
2	Muse Spark 1.3	0.1107	$38.26	178.6M	566k	18h 5m	654	36
3	Muse Spark 1.3	0.0286	$195.94	191.4M	452k	19h 7m	684	7
4	Muse Spark 1.3	0.0107	$34.91	148.6M	508k	14h 14m	577	15
5	Muse Spark 1.3	0.0036	$74.56	160.5M	728k	11h 20m	628	10

SGLang Inference System Optimization

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.1159	$180.28	204.8M	347k	10h 27m	670	14
2	Muse Spark 1.3	0.0000	$429.35	454.7M	706k	19h 28m	1165	8
3	Muse Spark 1.3	0.0000	$58.36	60.2M	197k	8h 23m	386	3
4	Muse Spark 1.3	0.0000	$52.36	191.1M	288k	7h 43m	680	5
5	Muse Spark 1.3	0.0000	$73.59	99.0M	263k	5h 24m	459	3

Snooker Prediction

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.3826	$317.27	411.4M	767k	19h 50m	1032	4
2	Muse Spark 1.3	0.3439	$236.90	672.0M	957k	19h 49m	1569	5
3	Muse Spark 1.3	0.0370	$445.62	445.7M	615k	19h 19m	857	8
4	Muse Spark 1.3	0.0000	$518.18	574.1M	1.1M	19h 44m	1290	6
5	Muse Spark 1.3	0.0000	$449.88	491.2M	832k	19h 52m	1176	2

SPICE Circuit Simulator in Rust

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.5758	$268.72	1376.2M	2.2M	19h 51m	3328	2
2	Muse Spark 1.3	0.5657	$460.65	531.6M	1.1M	17h 48m	1347	4
3	Muse Spark 1.3	0.5455	$559.10	664.1M	1.1M	19h 47m	1540	5
4	Muse Spark 1.3	0.4646	$547.17	608.4M	1.3M	19h 44m	1331	3
5	Muse Spark 1.3	0.3939	$557.80	621.9M	1.5M	19h 58m	1391	1

Stepper Music Sequencer GBA

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.5524	$214.49	1195.2M	2.0M	12h 19m	2846	1
2	Muse Spark 1.3	0.3727	$330.62	1484.1M	2.3M	19h 59m	3305	30
3	Muse Spark 1.3	0.3146	$507.64	559.8M	1.1M	19h 23m	1354	2
4	Muse Spark 1.3	0.0797	$528.52	575.6M	1.2M	19h 59m	1313	1
5	Muse Spark 1.3	0.0480	$556.48	567.3M	735k	19h 51m	1107	5

Synthetic Music Diarization

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.4569	$29.57	105.7M	282k	17h 55m	519	8
2	Muse Spark 1.3	0.4340	$126.99	121.2M	301k	15h 7m	437	9
3	Muse Spark 1.3	0.4243	$152.31	160.5M	376k	14h 14m	500	7
4	Muse Spark 1.3	0.4206	$121.45	118.8M	279k	16h 52m	510	21
5	Muse Spark 1.3	0.3962	$92.96	91.1M	258k	17h 50m	454	10

Verilog Simulator in Swift

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.5582	$533.21	614.5M	1.1M	19h 59m	1577	1
2	Muse Spark 1.3	0.5497	$512.38	619.2M	1.1M	19h 59m	1598	1
3	Muse Spark 1.3	0.4932	$275.58	1496.0M	1.9M	19h 49m	3361	3
4	Muse Spark 1.3	0.4932	$515.26	603.1M	1.3M	19h 58m	1473	2
5	Muse Spark 1.3	0.4384	$522.03	583.4M	1.2M	19h 58m	1409	1

Vision-only TORCS Racing Bot

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.0388	$56.56	261.0M	256k	19h 53m	846	5
2	Muse Spark 1.3	0.0144	$191.47	315.7M	497k	17h 52m	814	9
3	Muse Spark 1.3	0.0029	$53.07	279.6M	311k	19h 59m	985	11
4	Muse Spark 1.3	0.0000†	$28.04	94.3M	152k	18h 59m	469	5
5	Muse Spark 1.3	0.0000†	$90.60	82.5M	232k	18h 53m	410	3

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.

Wan 2.1 on MAX/Mojo

task page →5 runs · indexed 2026-10-08

#	Model	Reward	Cost	In tok	Out tok	Time	Steps	Submits
1	Muse Spark 1.3	0.9348	$88.24	91.7M	303k	11h 17m	409	2
2	Muse Spark 1.3	0.9005	$242.82	232.9M	452k	19h 26m	628	1
3	Muse Spark 1.3	0.4425	$115.32	111.6M	449k	19h 59m	385	1
4	Muse Spark 1.3	0.4417	$126.25	155.2M	591k	19h 59m	465	1
5	Muse Spark 1.3	0.4389	$215.78	199.3M	678k	15h 8m	502	24