Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|---|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.1 | 0.9491 | $569.86 | 1069.9M | 1.4M | 17h 10m | 2285 | 28 |
| 2 | Claude Fable 5.1 | 0.9284 | $552.06 | 1031.1M | 1.5M | 18h 56m | 2091 | 46 |
| 3 | Claude Fable 5.1 | 0.9275 | $456.14 | 848.4M | 1.3M | 18h 57m | 2026 | 39 |
| 4 | Claude Fable 5.1 | 0.8919 | $415.43 | 774.8M | 1.2M | 19h 19m | 1796 | 47 |
| 5 | Claude Fable 5.1 | 0.8712 | $313.43 | 577.0M | 1.0M | 18h 15m | 1283 | 12 |
| 6 | GPT-5.6 | 0.7949 | $998.14 | 972.7M | 983k | 19h 18m | 2146 | 16 |
| 7 | GPT-5.6 | 0.6779 | $433.00 | 423.6M | 391k | 6h 1m | 844 | 4 |
| 8 | Gemini 3.7 Flash | 0.6517 | $199.28 | 2123.1M | 2.6M | 19h 55m | 4917 | 62 |
| 9 | GPT-5.6 | 0.6344 | $89.80 | 91.5M | 201k | 1h 55m | 362 | 5 |
| 10 | Muse Spark 1.2 | 0.6241 | $2.29 | 11.0M | 77k | 1h 6m | 128 | 3 |
| 11 | GPT-5.6 | 0.6068 | $48.47 | 52.9M | 204k | 1h 35m | 274 | 3 |
| 12 | Grok 4.6 | 0.5864 | $513.86 | 512.7M | 2.7M | 20h 0m | 2054 | 59 |
| 13 | Kimi K3 | 0.5650 | $209.81 | 607.6M | 1.3M | 20h 1m | 1454 | 19 |
| 14 | Kimi K3 | 0.5395 | $190.44 | 541.2M | 1.2M | 19h 50m | 1336 | 3 |
| 15 | Gemini 3.7 Flash | 0.5376 | $121.24 | 1110.9M | 1.5M | 19h 27m | 2524 | 37 |
| 16 | GLM-5.3 | 0.5299 | $165.74 | 599.8M | 1.1M | 19h 6m | 1398 | 51 |
| 17 | Kimi K3 | 0.4874 | $196.59 | 547.1M | 1.3M | 19h 46m | 1241 | 8 |
| 18 | Qwen3.8-Max | 0.4828 | $83.97 | 303.2M | 1.2M | 16h 38m | 893 | 2 |
| 19 | GLM-5.3 | 0.4696 | $158.77 | 595.9M | 645k | 19h 33m | 1177 | 12 |
| 20 | GLM-5.3 | 0.4653 | $144.84 | 516.1M | 611k | 19h 39m | 1066 | 22 |
| 21 | GLM-5.3 | 0.4595 | $150.71 | 560.0M | 706k | 19h 32m | 1263 | 35 |
| 22 | GPT-5.6 | 0.4547 | $71.79 | 84.5M | 237k | 2h 25m | 406 | 7 |
| 23 | Gemini 3.7 Flash | 0.4365 | $75.56 | 629.3M | 934k | 19h 55m | 1331 | 3 |
| 24 | Kimi K3 | 0.4305 | $123.27 | 338.1M | 738k | 19h 52m | 670 | 1 |
| 25 | Gemini 3.7 Flash | 0.4242 | $33.92 | 324.0M | 891k | 3h 25m | 780 | 8 |
| 26 | DeepSeek V4 Flash Vision Exp | 0.4014 | $18.12 | 1122.6M | 1.6M | 19h 51m | 2602 | 23 |
| 27 | GLM-5.3 | 0.3788 | $98.82 | 359.7M | 600k | 20h 0m | 738 | 1 |
| 28 | Qwen3.8-Max | 0.3212 | $156.83 | 579.3M | 1.7M | 20h 1m | 1506 | 1 |
| 29 | Gemini 3.7 Flash | 0.3137 | $25.24 | 282.5M | 578k | 1h 28m | 590 | 2 |
| 30 | Grok 4.6 | 0.3015 | $389.00 | 386.7M | 2.2M | 19h 53m | 1645 | 42 |
| 31 | Qwen3.8-Max | 0.2726 | $83.47 | 304.6M | 1.0M | 17h 28m | 843 | 2 |
| 32 | Qwen3.8-Max | 0.2674 | $50.86 | 177.6M | 941k | 18h 25m | 662 | 12 |
| 33 | DeepSeek V4 Flash Vision Exp | 0.2342 | $7.03 | 436.2M | 602k | 8h 13m | 914 | 3 |
| 34 | DeepSeek V4 Flash Vision Exp | 0.2234 | $21.23 | 1304.8M | 2.0M | 15h 38m | 2836 | 7 |
| 35 | Grok 4.6 | 0.1785 | $547.31 | 552.2M | 2.4M | 19h 52m | 2177 | 74 |
| 36 | DeepSeek V4 Flash Vision Exp | 0.1638 | $15.31 | 956.5M | 1.3M | 19h 4m | 2023 | 3 |
| 37 | Muse Spark 1.2 | 0.1043 | $2.53 | 9.5M | 123k | 1h 21m | 101 | 1 |
| 38 | Muse Spark 1.2 | 0.1040 | $2.18 | 10.0M | 104k | 1h 4m | 113 | 2 |
| 39 | Muse Spark 1.2 | 0.1040 | $3.41 | 16.0M | 109k | 59m | 110 | 2 |
| 40 | Qwen3.8-Max | 0.0853 | $104.77 | 373.0M | 1.7M | 19h 28m | 957 | 1 |
| 41 | DeepSeek V4 Flash Vision Exp | 0.0766 | $15.69 | 953.5M | 1.5M | 16h 48m | 2199 | 5 |
| 42 | Muse Spark 1.2 | 0.0377 | $5.55 | 30.5M | 146k | 1h 16m | 174 | 2 |
| 43 | Inkling | 0.0000 | $2.95 | 3.1M | 10k | 11m | 87 | 2 |
| 44 | Inkling | 0.0000 | $20.49 | 21.4M | 45k | 32m | 241 | 1 |
| 45 | Grok 4.6 | 0.0000 | $485.05 | 493.3M | 2.2M | 19h 52m | 1992 | 109 |
| 46 | Grok 4.6 | 0.0000 | $402.09 | 394.7M | 2.1M | 17h 23m | 1524 | 78 |
| 47 | Inkling | 0.0000 | $19.88 | 20.7M | 49k | 1h 2m | 297 | 1 |
| 48 | Inkling | 0.0000 | $7.80 | 8.1M | 20k | 1h 3m | 140 | 1 |
| 49 | Inkling | 0.0000 | $4.62 | 4.8M | 11k | 1h 10m | 101 | 2 |
| 50 | Kimi K3 | 0.0000 | $86.57 | 238.4M | 589k | 20h 1m | 593 | 1 |