Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|---|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.1 | 0.8857 | $37.59 | 60.9M | 295k | 9h 18m | 239 | 6 |
| 2 | Claude Fable 5.1 | 0.8752 | $40.65 | 67.2M | 290k | 7h 39m | 274 | 9 |
| 3 | Claude Fable 5.1 | 0.8680 | $40.94 | 67.5M | 295k | 10h 23m | 279 | 9 |
| 4 | Claude Fable 5.1 | 0.8599 | $41.23 | 67.7M | 303k | 9h 29m | 256 | 9 |
| 5 | Claude Fable 5.1 | 0.8541 | $59.53 | 101.1M | 368k | 11h 5m | 353 | 7 |
| 6 | GPT-5.6 | 0.7946 | $58.77 | 77.9M | 203k | 6h 45m | 423 | 8 |
| 7 | GPT-5.6 | 0.7781 | $75.11 | 86.9M | 202k | 10h 41m | 410 | 11 |
| 8 | Gemini 3.7 Flash | 0.7591 | $2.33 | 9.2M | 139k | 1h 43m | 99 | 2 |
| 9 | GLM-5.3 | 0.7535 | $23.46 | 64.7M | 277k | 19h 3m | 267 | 6 |
| 10 | Kimi K3 | 0.7526 | $40.44 | 107.3M | 401k | 19h 37m | 387 | 17 |
| 11 | Grok 4.6 | 0.7350 | $123.13 | 116.9M | 502k | 9h 53m | 414 | 28 |
| 12 | GLM-5.3 | 0.7343 | $45.48 | 90.2M | 303k | 16h 27m | 365 | 4 |
| 13 | GPT-5.6 | 0.7314 | $114.07 | 131.6M | 228k | 8h 56m | 569 | 14 |
| 14 | GPT-5.6 | 0.7190 | $154.11 | 169.8M | 283k | 6h 40m | 688 | 13 |
| 15 | Kimi K3 | 0.7151 | $55.15 | 146.5M | 497k | 20h 0m | 484 | 14 |
| 16 | GPT-5.6 | 0.7125 | $69.33 | 92.1M | 185k | 8h 7m | 475 | 5 |
| 17 | Kimi K3 | 0.6987 | $79.07 | 224.2M | 641k | 20h 1m | 556 | 12 |
| 18 | GLM-5.3 | 0.6907 | $44.40 | 135.6M | 383k | 15h 8m | 392 | 12 |
| 19 | Grok 4.6 | 0.6883 | $68.03 | 60.3M | 544k | 3h 28m | 249 | 6 |
| 20 | Qwen3.8-Max | 0.6875 | $16.94 | 52.6M | 563k | 18h 44m | 340 | 2 |
| 21 | Grok 4.6 | 0.6689 | $82.90 | 75.9M | 477k | 3h 6m | 283 | 17 |
| 22 | Gemini 3.7 Flash | 0.6672 | $3.04 | 15.3M | 126k | 1h 37m | 140 | 1 |
| 23 | Grok 4.6 | 0.6619 | $46.47 | 48.9M | 429k | 4h 33m | 274 | 7 |
| 24 | Gemini 3.7 Flash | 0.6446 | $3.44 | 16.9M | 214k | 2h 28m | 151 | 2 |
| 25 | GLM-5.3 | 0.6370 | $18.59 | 55.0M | 231k | 19h 13m | 287 | 3 |
| 26 | Kimi K3 | 0.6270 | $30.79 | 76.7M | 394k | 12h 20m | 318 | 20 |
| 27 | Kimi K3 | 0.6254 | $97.66 | 258.3M | 819k | 19h 58m | 576 | 17 |
| 28 | DeepSeek V4 Flash Vision Exp | 0.6244 | $2.53 | 133.2M | 457k | 10h 50m | 402 | 7 |
| 29 | Muse Spark 1.2 | 0.6114 | $9.23 | 47.6M | 407k | 3h 16m | 262 | 4 |
| 30 | Gemini 3.7 Flash | 0.6074 | $16.26 | 72.9M | 429k | 6h 43m | 280 | 5 |
| 31 | GLM-5.3 | 0.6071 | $32.20 | 106.0M | 372k | 12h 23m | 375 | 5 |
| 32 | Muse Spark 1.2 | 0.5947 | $9.36 | 45.3M | 339k | 3h 54m | 244 | 2 |
| 33 | Grok 4.6 | 0.5924 | $84.01 | 82.0M | 496k | 4h 20m | 336 | 10 |
| 34 | Muse Spark 1.2 | 0.5914 | $9.21 | 41.8M | 337k | 3h 53m | 230 | 2 |
| 35 | Gemini 3.7 Flash | 0.5912 | $5.63 | 44.5M | 188k | 5h 26m | 270 | 1 |
| 36 | Muse Spark 1.2 | 0.5787 | $10.64 | 52.8M | 389k | 2h 30m | 272 | 8 |
| 37 | Qwen3.8-Max | 0.5728 | $25.90 | 85.8M | 648k | 18h 2m | 442 | 6 |
| 38 | Muse Spark 1.2 | 0.5545 | $7.70 | 42.7M | 226k | 2h 46m | 257 | 5 |
| 39 | DeepSeek V4 Flash Vision Exp | 0.5485 | $2.27 | 120.4M | 400k | 9h 24m | 405 | 3 |
| 40 | DeepSeek V4 Flash Vision Exp | 0.4883 | $3.26 | 177.3M | 519k | 9h 8m | 426 | 7 |
| 41 | DeepSeek V4 Flash Vision Exp | 0.4768 | $2.33 | 127.1M | 362k | 12h 24m | 407 | 4 |
| 42 | Qwen3.8-Max | 0.4459 | $25.19 | 78.5M | 819k | 19h 40m | 374 | 2 |
| 43 | DeepSeek V4 Flash Vision Exp | 0.4348 | $2.35 | 127.0M | 382k | 9h 0m | 395 | 7 |
| 44 | Inkling | 0.4268 | $4.27 | 4.3M | 39k | 1h 28m | 101 | 2 |
| 45 | Qwen3.8-Max | 0.4074 | $19.97 | 63.7M | 596k | 17h 56m | 390 | 2 |
| 46 | Qwen3.8-Max | 0.2765 | $43.05 | 138.5M | 1.3M | 20h 1m | 512 | 1 |
| 47 | Inkling | 0.2712 | $3.61 | 3.7M | 31k | 1h 49m | 90 | 2 |
| 48 | Inkling | 0.2062 | $7.66 | 7.9M | 44k | 1h 46m | 158 | 2 |
| 49 | Inkling | 0.1413 | $4.71 | 4.8M | 39k | 39m | 98 | 2 |
| 50 | Inkling | 0.0057 | $3.81 | 3.8M | 60k | 1h 38m | 95 | 1 |