Traces

Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.

Kolmogorov Audio Compression

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0073$7.838.2M21k1h 33m1412
2Inkling0.0061$5.435.5M41k1h 2m1472
3Inkling0.0061$13.6714.2M40k2h 24m2252
4Inkling0.0039$4.624.8M24k1h 6m1011
5Inkling0.0030$5.705.9M31k2h 11m1451

Astronomy Toolkit

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$4.594.7M24k22m1052
2Inkling0.0000$5.986.1M33k29m1441
3Inkling0.0000$2.972.9M45k43m1092
4Inkling0.0000$6.496.6M47k1h 53m1421
5Inkling0.0000$6.066.2M36k1h 0m1182

Cranelift Codegen Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$8.388.8M12k55m941
2Inkling0.0000$13.7514.4M22k1h 40m1352
3Inkling0.0000$11.7912.4M15k1h 2m1211
4Inkling0.0000$8.248.6M21k30m1042
5Inkling0.0000$13.8214.5M21k59m1372

Dart Style in Haskell

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$2.953.1M10k11m872
2Inkling0.0000$20.4921.4M45k32m2411
3Inkling0.0000$19.8820.7M49k1h 2m2971
4Inkling0.0000$7.808.1M20k1h 3m1401
5Inkling0.0000$4.624.8M11k1h 10m1012

FFmpeg libswscale Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$11.2411.7M27k1h 20m1652
2Inkling0.0000$15.4516.1M35k22m1882
3Inkling0.0000$39.6641.4M77k41m3542
4Inkling0.0000$15.5116.2M36k32m1901
5Inkling0.0000$11.1711.6M27k16m1671

Crash-Proof Flash Filesystem

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$14.1614.7M37k1h 30m1842
2Inkling0.0000$9.309.7M22k11m1232
3Inkling0.0000$12.0812.6M23k14m1612
4Inkling0.0000$16.4517.2M21k16m1732
5Inkling0.0000$13.1713.7M28k1h 27m1862

FrogsGame Post-Training

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0080$2.602.6M22k28m842
2Inkling0.0000$8.378.7M31k38m1692
3Inkling0.0000$3.543.7M16k24m972
4Inkling0.0000$1.631.6M18k24m712
5Inkling0.0000$2.522.6M17k28m1032

Stepper Music Sequencer GBA

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$3.823.9M21k15m1032
2Inkling0.0000$6.626.9M28k22m1681
3Inkling0.0000$8.488.8M35k24m1712
4Inkling0.0000$10.6411.1M32k19m1931
5Inkling0.0000$5.725.9M31k22m1402

Git to Zig

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.1510$17.7718.6M32k1h 29m2551
2Inkling0.0093$17.5218.3M28k1h 29m2083
3Inkling0.0019$16.3617.1M30k17m2801
4Inkling0.0000$3.153.3M13k5m862
5Inkling0.0000$5.575.8M17k1h 55m1182

† score adjusted by manual review; the trace's Judge tab carries the measured score and the rationale.

Granite Mamba2 Inference Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.7968$5.415.6M24k1h 10m983
2Inkling0.7910$2.642.7M12k47m612
3Inkling0.7670$5.685.8M36k1h 22m1012
4Inkling0.0000$7.507.7M51k1h 46m1351
5Inkling0.0000$4.664.8M18k1h 13m912

Higgs Uncertainty Inference

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.8760$6.246.3M65k37m1401
2Inkling0.0078$3.623.6M51k2h 38m1201
3Inkling0.0004$3.373.3M54k1h 37m1041
4Inkling0.0004$4.084.1M54k1h 12m1122
5Inkling0.0000$2.472.5M36k1h 12m1061

SGLang Inference System Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$4.875.1M12k1h 40m923
2Inkling0.0000$7.608.0M10k1h 46m1202
3Inkling0.0000$5.185.4M12k1h 28m912
4Inkling0.0000$6.426.7M16k1h 12m1001
5Inkling0.0000$14.7615.4M36k34m1942

Lean 4 Kernel Type Checker in Pascal

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$5.565.7M37k1h 16m1152
2Inkling0.0000$5.465.6M34k55m1072
3Inkling0.0000$5.705.9M22k14m802
4Inkling0.0000$13.8114.4M43k1h 26m1751
5Inkling0.0000$6.566.8M25k12m1096

libexpat Optimization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$23.4724.5M46k39m3592
2Inkling0.0000$3.703.7M39k18m852
3Inkling0.0000$18.3619.0M75k47m2514
4Inkling0.0000$3.583.6M31k16m742
5Inkling0.0000$3.113.2M24k13m823

Lua Native Compiler

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$27.7428.9M72k42m3001
2Inkling0.0000$16.9217.5M67k44m2211
3Inkling0.0000$48.6250.6M132k1h 1m3672
4Inkling0.0000$14.8115.3M75k53m2231
5Inkling0.0000$7.918.2M23k26m1652

Machine-Learned Interatomic Potential

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0572$3.463.5M36k2h 37m1361
2Inkling0.0431$4.945.0M59k45m1201
3Inkling0.0393$6.847.0M43k1h 26m1811
4Inkling0.0179$5.355.4M56k1h 32m1262
5Inkling0.0126$4.985.1M42k1h 33m1482

Medium-Range Weather Forecast

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.2568$3.543.6M37k1h 43m971
2Inkling0.2237$3.913.9M47k1h 43m1201
3Inkling0.1542$5.245.4M39k1h 50m1322
4Inkling0.1482$3.493.6M19k1h 32m1021
5Inkling0.0000$6.206.2M72k38m1321

MEG Speech Decoding

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$5.295.5M26k1h 28m1511
2Inkling0.0000$5.015.2M28k1h 29m1281
3Inkling0.0000$6.236.3M53k2h 6m1391
4Inkling0.0000$5.315.5M23k2h 3m1342
5Inkling0.0000$5.425.6M24k1h 30m1161

Wan 2.1 on MAX/Mojo

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0429$17.1217.9M30k2h 11m1921
2Inkling0.0404$13.8514.5M23k1h 11m1421
3Inkling0.0305$12.9313.5M35k14m1411
4Inkling0.0000$16.0516.8M29k1h 23m1762
5Inkling0.0000$11.4711.9M30k1h 18m1452

MS/MS De Novo Generation

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$4.784.9M42k32m1361
2Inkling0.0000$9.609.7M91k1h 37m1871
3Inkling0.0000$4.224.3M40k1h 20m1252
4Inkling0.0000$9.219.4M67k2h 19m2351
5Inkling0.0000$6.196.3M42k29m1201

Multi-GPU Efficient Finetuning

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.5238$11.7812.1M59k1h 35m1661
2Inkling0.0476$5.355.5M24k1h 26m1322
3Inkling0.0238$14.2214.8M45k2h 19m2191
4Inkling0.0000$6.666.8M46k2h 1m1351
5Inkling0.0000$4.164.3M15k34m1073

Notebook Compression

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0214$5.305.4M31k3h 11m1842
2Inkling0.0209$6.766.9M44k2h 24m1932
3Inkling0.0205$8.128.4M30k3h 20m1851
4Inkling0.0203$5.445.6M27k1h 39m1213
5Inkling0.0179$5.866.0M36k2h 37m1662

Flight-Sim Renderer in OpenGL

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$6.727.0M25k22m1382
2Inkling0.0000$6.596.8M31k2h 10m1462
3Inkling0.0000$6.576.8M31k35m1561
4Inkling0.0000$4.244.4M17k41m1091
5Inkling0.0000$8.879.2M43k1h 49m1702

Optimizer Design

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$1.081.1M14k1h 4m581
2Inkling0.0000$1.531.5M16k1h 13m732
3Inkling0.0000$3.843.9M25k5h 18m1241
4Inkling0.0000$2.542.6M28k2h 1m881
5Inkling0.0000$1.631.6M27k1h 46m731

PostgreSQL 18 on SQLite

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$22.3423.3M56k1h 53m3403
2Inkling0.0000$19.0619.8M53k1h 41m3022
3Inkling0.0000$19.0419.9M46k23m2521
4Inkling0.0000$16.5617.2M48k32m2142
5Inkling0.0000$16.6217.3M42k34m2871

Quantum ESPRESSO pw.x in Rust

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$18.6819.4M66k28m1862
2Inkling0.0000$22.9424.0M46k17m2741
3Inkling0.0000$8.198.5M35k16m1421
4Inkling0.0000$9.259.5M49k17m1462
5Inkling0.0000$9.329.6M44k15m1382

Qubit Routing

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.4268$4.274.3M39k1h 28m1012
2Inkling0.2712$3.613.7M31k1h 49m902
3Inkling0.2062$7.667.9M44k1h 46m1582
4Inkling0.1413$4.714.8M39k39m982
5Inkling0.0057$3.813.8M60k1h 38m951

Reconnaissance Blind Chess Recovery

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.2000$1.231.2M15k1h 37m461
2Inkling0.0786$1.371.4M14k43m621
3Inkling0.0393$5.275.4M45k1h 49m1272
4Inkling0.0143$2.102.1M21k28m831
5Inkling0.0000$3.914.0M36k2h 12m982

Fitness-Recap Video in Remotion

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0006$14.0514.6M38k1h 0m1831
2Inkling0.0001$7.968.3M26k31m1412
3Inkling0.0000$13.7214.2M49k59m2051
4Inkling0.0000$10.6511.1M29k1h 18m1722
5Inkling0.0000$11.1511.6M44k40m1381

Snooker Prediction

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0335$2.612.6M26k1h 16m722
2Inkling0.0203$2.912.9M46k1h 53m872
3Inkling0.0000$3.243.2M40k1h 45m1031
4Inkling0.0000$2.842.7M69k45m822
5Inkling0.0000$1.801.8M26k14m792

SPICE Circuit Simulator in Rust

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0000$4.424.6M23k45m831
2Inkling0.0000$19.3020.1M40k1h 20m1702
3Inkling0.0000$1.041.1M10k27m522
4Inkling0.0000$5.075.3M18k1h 13m1102
5Inkling0.0000$5.215.3M32k15m1242

Synthetic Music Diarization

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.2089$6.226.4M44k35m1312
2Inkling0.0477$6.406.6M38k28m1231
3Inkling0.0074$12.0812.5M45k59m1601
4Inkling0.0053$5.675.8M48k1h 31m992
5Inkling0.0012$9.519.9M36k38m1701

Vision-only TORCS Racing Bot

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0559$112.11117.1M218k1h 53m8111
2Inkling0.0186$4.324.4M39k1h 1m1221
3Inkling0.0129$1.441.4M20k2h 0m841
4Inkling0.0031$5.445.4M67k1h 58m1202
5Inkling0.0025$2.422.4M30k2h 1m892

Verilog Simulator in Swift

task page →5 runs · indexed 2026-09-02
#ModelRewardCostIn tokOut tokTimeStepsSubmits
1Inkling0.0017$19.9320.8M47k1h 36m2831
2Inkling0.0000$3.273.4M20k1h 3m982
3Inkling0.0000$13.3613.9M43k1h 28m2271
4Inkling0.0000$2.172.2M13k1h 11m801
5Inkling0.0000$9.6410.0M34k1h 28m1692