Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|---|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.1 | 0.9431 | $100.68 | 158.8M | 876k | 5h 35m | 408 | 11 |
| 2 | Claude Fable 5.1 | 0.9350 | $63.80 | 99.1M | 584k | 3h 4m | 218 | 8 |
| 3 | Claude Fable 5.1 | 0.9268 | $63.95 | 99.7M | 578k | 3h 23m | 222 | 5 |
| 4 | Claude Fable 5.1 | 0.9187 | $72.59 | 116.9M | 580k | 4h 7m | 245 | 5 |
| 5 | Claude Fable 5.1 | 0.9106 | $77.90 | 124.4M | 643k | 3h 55m | 256 | 4 |
| 6 | GPT-5.6 | 0.5203 | $304.21 | 296.3M | 260k | 4h 50m | 606 | 9 |
| 7 | GPT-5.6 | 0.4634 | $57.42 | 64.9M | 189k | 2h 47m | 279 | 13 |
| 8 | GPT-5.6 | 0.4553 | $120.99 | 116.9M | 214k | 5h 5m | 404 | 8 |
| 9 | GPT-5.6 | 0.4065 | $104.97 | 107.5M | 204k | 3h 16m | 391 | 10 |
| 10 | Grok 4.6 | 0.3984 | $196.95 | 181.0M | 1.6M | 13h 51m | 681 | 14 |
| 11 | Grok 4.6 | 0.3008 | $282.67 | 273.1M | 1.6M | 13h 49m | 976 | 40 |
| 12 | Grok 4.6 | 0.2683 | $1211.08 | 1191.6M | 2.2M | 19h 59m | 3559 | 243 |
| 13 | Kimi K3 | 0.2602 | $75.00 | 147.3M | 1.2M | 19h 51m | 428 | 1 |
| 14 | GLM-5.3 | 0.1707 | $145.94 | 507.1M | 1.3M | 19h 30m | 1082 | 13 |
| 15 | Gemini 3.7 Flash | 0.1545 | $46.71 | 314.3M | 747k | 10h 28m | 740 | 2 |
| 16 | GLM-5.3 | 0.1382 | $132.96 | 476.8M | 1.3M | 19h 42m | 984 | 12 |
| 17 | GLM-5.3 | 0.1301 | $108.12 | 382.4M | 1.3M | 19h 32m | 838 | 2 |
| 18 | Grok 4.6 | 0.1057 | $123.16 | 111.5M | 1.7M | 10h 28m | 429 | 13 |
| 19 | Grok 4.6 | 0.0976 | $96.14 | 88.3M | 1.1M | 7h 19m | 360 | 12 |
| 20 | Gemini 3.7 Flash | 0.0976 | $71.79 | 423.8M | 777k | 17h 50m | 948 | 3 |
| 21 | Gemini 3.7 Flash | 0.0650 | $36.49 | 288.8M | 712k | 6h 10m | 725 | 2 |
| 22 | GLM-5.3 | 0.0650 | $123.53 | 403.7M | 1.6M | 19h 19m | 957 | 11 |
| 23 | Kimi K3 | 0.0488 | $160.13 | 415.5M | 1.7M | 20h 0m | 999 | 1 |
| 24 | Muse Spark 1.2 | 0.0244 | $48.27 | 287.1M | 1.0M | 3h 0m | 598 | 1 |
| 25 | Kimi K3 | 0.0244 | $100.42 | 211.3M | 1.8M | 20h 0m | 566 | 1 |
| 26 | Kimi K3 | 0.0081 | $131.87 | 355.0M | 1.3M | 19h 56m | 785 | 6 |
| 27 | Qwen3.8-Max | 0.0000 | $48.53 | 146.5M | 1.8M | 19h 49m | 431 | 1 |
| 28 | DeepSeek V4 Flash Vision Exp | 0.0000 | $7.62 | 422.1M | 1.1M | 12h 5m | 912 | 6 |
| 29 | Gemini 3.7 Flash | 0.0000 | $51.00 | 393.0M | 804k | 11h 3m | 1002 | 4 |
| 30 | Kimi K3 | 0.0000 | $72.76 | 158.2M | 1.2M | 20h 1m | 418 | 1 |
| 31 | Muse Spark 1.2 | 0.0000 | $22.08 | 58.0M | 685k | 1h 30m | 194 | 3 |
| 32 | Qwen3.8-Max | 0.0000 | $54.35 | 159.6M | 2.3M | 19h 59m | 413 | 1 |
| 33 | Qwen3.8-Max | 0.0000 | $33.37 | 86.6M | 1.8M | 19h 52m | 301 | 2 |
| 34 | Gemini 3.7 Flash | 0.0000 | $24.96 | 238.1M | 690k | 3h 15m | 539 | 2 |
| 35 | Inkling | 0.0000 | $18.68 | 19.4M | 66k | 28m | 186 | 2 |
| 36 | DeepSeek V4 Flash Vision Exp | 0.0000 | $6.14 | 336.4M | 959k | 16h 29m | 853 | 10 |
| 37 | Inkling | 0.0000 | $22.94 | 24.0M | 46k | 17m | 274 | 1 |
| 38 | DeepSeek V4 Flash Vision Exp | 0.0000 | $4.17 | 227.6M | 660k | 6h 35m | 447 | 3 |
| 39 | GPT-5.6 | 0.0000 | $210.32 | 203.5M | 250k | 6h 57m | 577 | 6 |
| 40 | Inkling | 0.0000 | $8.19 | 8.5M | 35k | 16m | 142 | 1 |
| 41 | Muse Spark 1.2 | 0.0000 | $8.00 | 39.5M | 393k | 1h 21m | 166 | 2 |
| 42 | Inkling | 0.0000 | $9.25 | 9.5M | 49k | 17m | 146 | 2 |
| 43 | DeepSeek V4 Flash Vision Exp | 0.0000 | $6.64 | 359.4M | 1.1M | 12h 22m | 882 | 5 |
| 44 | GLM-5.3 | 0.0000 | $103.68 | 348.9M | 1.2M | 19h 23m | 795 | 14 |
| 45 | DeepSeek V4 Flash Vision Exp | 0.0000 | $6.97 | 389.0M | 1.0M | 14h 29m | 887 | 5 |
| 46 | Muse Spark 1.2 | 0.0000 | $5.45 | 30.5M | 131k | 29m | 160 | 3 |
| 47 | Qwen3.8-Max | 0.0000 | $35.43 | 95.7M | 1.8M | 20h 1m | 338 | 1 |
| 48 | Inkling | 0.0000 | $9.32 | 9.6M | 44k | 15m | 138 | 2 |
| 49 | Muse Spark 1.2 | 0.0000 | $10.30 | 54.9M | 392k | 1h 20m | 248 | 4 |
| 50 | Qwen3.8-Max | 0.0000 | $11.62 | 13.4M | 1.3M | 19h 53m | 112 | 1 |