Every run: the agent's full trajectory, its submissions over the 20-hour budget, and the final score.
| # | Model | Reward | Cost | In tok | Out tok | Time | Steps | Submits |
|---|---|---|---|---|---|---|---|---|
| 1 | GPT-6 Astra | 1.0000 | $2526.29 | 1186.0M | 2.6M | 19h 52m | 2748 | 60 |
| 2 | GPT-6 Astra | 1.0000 | $2608.33 | 1211.7M | 2.6M | 19h 14m | 2577 | 57 |
| 3 | GPT-6 Astra | 1.0000 | $2728.80 | 1295.7M | 2.6M | 19h 47m | 2920 | 59 |
| 4 | GPT-6 Astra | 1.0000 | $1955.97 | 919.3M | 1.8M | 13h 34m | 2031 | 27 |
| 5 | Gemini 4 Argon | 0.1051 | $267.43 | 253.9M | 1.3M | 20h 43m | 650 | 14 |
| 6 | Claude Sonnet 5.5 | 0.0978 | $108.60 | 441.2M | 1.6M | 19h 39m | 1051 | 10 |
| 7 | Claude Sonnet 5.5 | 0.0941 | $68.80 | 277.4M | 1.1M | 19h 3m | 695 | 1 |
| 8 | Claude Sonnet 5.5 | 0.0934 | $70.90 | 283.8M | 1.1M | 19h 20m | 689 | 13 |
| 9 | Claude Sonnet 5.5 | 0.0867 | $89.81 | 366.1M | 1.3M | 19h 24m | 779 | 15 |
| 10 | Claude Opus 5.5 | 0.0856 | $64.20 | 240.0M | 620k | 16h 10m | 530 | 20 |
| 11 | Claude Sonnet 5.5 | 0.0850 | $134.99 | 552.5M | 1.9M | 17h 54m | 1174 | 6 |
| 12 | Claude Opus 5.5 | 0.0830 | $83.18 | 303.7M | 858k | 18h 27m | 759 | 19 |
| 13 | Claude Opus 5.5 | 0.0789 | $67.50 | 264.9M | 554k | 16h 28m | 614 | 17 |
| 14 | Gemini 4 Argon | 0.0786 | $189.34 | 268.5M | 1.6M | 19h 23m | 661 | 14 |
| 15 | Claude Opus 5.5 | 0.0783 | $41.46 | 140.9M | 515k | 18h 1m | 396 | 17 |
| 16 | Claude Fable 5.1 | 0.0779 | $45.19 | 77.6M | 262k | 17h 49m | 334 | 16 |
| 17 | Gemini 4 Argon | 0.0759 | $254.33 | 211.1M | 1.1M | 19h 34m | 466 | 11 |
| 18 | Claude Fable 5.1 | 0.0754 | $52.35 | 88.6M | 331k | 12h 35m | 339 | 10 |
| 19 | Claude Fable 5.1 | 0.0711 | $71.87 | 125.0M | 385k | 17h 43m | 414 | 18 |
| 20 | Claude Opus 5 | 0.0709 | $49.79 | 73.0M | 367k | 18h 21m | 287 | 9 |
| 21 | Claude Opus 5 | 0.0708 | $49.82 | 72.2M | 372k | 18h 28m | 258 | 6 |
| 22 | Claude Opus 5 | 0.0704 | $79.01 | 124.4M | 464k | 18h 51m | 366 | 13 |
| 23 | GPT-6 Astra | 0.0696 | $683.33 | 329.9M | 756k | 19h 26m | 879 | 16 |
| 24 | Claude Fable 5.1 | 0.0695 | $54.46 | 93.0M | 327k | 16h 46m | 347 | 11 |
| 25 | Claude Opus 5.5 | 0.0694 | $57.79 | 216.0M | 560k | 18h 11m | 500 | 14 |
| 26 | Claude Fable 5 | 0.0684 | $67.93 | 48.0M | 274k | 18h 50m | 256 | 7 |
| 27 | Claude Fable 5.1 | 0.0678 | $47.98 | 81.1M | 304k | 16h 17m | 333 | 10 |
| 28 | Claude Haiku 5.5 | 0.0650 | $9.87 | 161.3M | 651k | 11h 38m | 367 | 1 |
| 29 | Gemini 4 Argon | 0.0648 | $246.66 | 202.6M | 896k | 20h 43m | 508 | 10 |
| 30 | Claude Opus 5 | 0.0619 | $46.80 | 66.5M | 370k | 18h 0m | 250 | 9 |
| 31 | Claude Fable 5 | 0.0592 | $121.06 | 93.1M | 386k | 19h 25m | 340 | 15 |
| 32 | Claude Haiku 5.5 | 0.0578 | $7.35 | 119.4M | 510k | 11h 49m | 313 | 9 |
| 33 | Claude Haiku 5.5 | 0.0569 | $7.56 | 123.0M | 501k | 18h 46m | 329 | 4 |
| 34 | Claude Haiku 5.5 | 0.0566 | $12.02 | 190.2M | 959k | 14h 47m | 486 | 5 |
| 35 | Claude Fable 5 | 0.0559 | $85.54 | 62.1M | 330k | 17h 58m | 277 | 11 |
| 36 | Gemini 4 Argon | 0.0474 | $174.59 | 205.7M | 1.1M | 13h 22m | 472 | 18 |
| 37 | Grok 4.7 | 0.0462 | $180.50 | 154.3M | 515k | 19h 45m | 631 | 5 |
| 38 | Claude Fable 5 | 0.0444 | $66.84 | 47.5M | 265k | 18h 38m | 234 | 5 |
| 39 | GPT-5.6 Sol | 0.0416 | $183.22 | 165.9M | 262k | 15h 47m | 471 | 12 |
| 40 | Claude Haiku 5.5 | 0.0415 | $8.31 | 137.0M | 537k | 14h 59m | 362 | 2 |
| 41 | GPT-5.6 Sol | 0.0408 | $43.32 | 47.2M | 136k | 19h 34m | 249 | 10 |
| 42 | Claude Fable 5 | 0.0392 | $102.94 | 78.4M | 342k | 18h 53m | 317 | 19 |
| 43 | GLM-5.3 | 0.0369 | $28.71 | 91.1M | 330k | 19h 38m | 343 | 2 |
| 44 | GLM-5.3 | 0.0349 | $48.94 | 118.7M | 352k | 19h 6m | 384 | 2 |
| 45 | Grok 4.7 | 0.0329 | $52.47 | 42.4M | 229k | 5h 56m | 210 | 12 |
| 46 | GLM-5.3 Flash | 0.0316 | $3.90 | 73.7M | 369k | 19h 44m | 299 | 7 |
| 47 | Grok 4.7 | 0.0313 | $93.78 | 78.9M | 256k | 12h 4m | 313 | 14 |
| 48 | Kimi K3 | 0.0313 | $38.45 | 102.2M | 362k | 20h 1m | 397 | 10 |
| 49 | GLM-5.3 Flash | 0.0303 | $10.53 | 223.0M | 596k | 19h 20m | 502 | 15 |
| 50 | GLM-5.3 | 0.0298 | $35.18 | 91.1M | 311k | 19h 41m | 366 | 13 |
| 51 | GLM-5.3 Flash | 0.0288 | $2.96 | 83.8M | 329k | 18h 56m | 365 | 2 |
| 52 | GLM-5.3 Flash | 0.0270 | $4.30 | 96.9M | 346k | 19h 28m | 348 | 3 |
| 53 | DeepSeek V4 Flash Vision Exp | 0.0268 | $2.15 | 112.2M | 397k | 7h 43m | 389 | 3 |
| 54 | Kimi K3 | 0.0266 | $26.15 | 60.2M | 321k | 19h 29m | 303 | 13 |
| 55 | GLM-5.3 | 0.0264 | $29.01 | 75.1M | 335k | 17h 41m | 311 | 6 |
| 56 | Kimi K3 | 0.0251 | $50.26 | 120.4M | 460k | 19h 45m | 410 | 7 |
| 57 | Kimi K3 | 0.0250 | $34.53 | 93.2M | 354k | 19h 44m | 395 | 8 |
| 58 | Muse Spark 1.3 | 0.0247 | $73.55 | 80.1M | 351k | 10h 48m | 392 | 7 |
| 59 | GLM-5.3 | 0.0243 | $29.39 | 96.9M | 323k | 19h 43m | 356 | 1 |
| 60 | Gemini 3.7 Flash | 0.0240 | $13.44 | 120.0M | 296k | 7h 42m | 465 | 7 |
| 61 | Gemini 3.7 Flash | 0.0232 | $21.26 | 112.5M | 588k | 9h 45m | 340 | 20 |
| 62 | DeepSeek V4 Flash Vision Exp | 0.0228 | $5.13 | 304.7M | 583k | 13h 30m | 712 | 7 |
| 63 | GPT-5.6 Sol | 0.0224 | $49.42 | 77.2M | 169k | 19h 53m | 422 | 11 |
| 64 | Grok 4.6 | 0.0221 | $127.10 | 131.5M | 617k | 19h 58m | 617 | 30 |
| 65 | Grok 4.7 | 0.0218 | $33.81 | 32.7M | 228k | 2h 52m | 171 | 8 |
| 66 | Muse Spark 1.3 | 0.0215 | $70.26 | 70.8M | 222k | 11h 3m | 366 | 12 |
| 67 | Muse Spark 1.3 | 0.0200 | $64.21 | 65.3M | 198k | 19h 54m | 404 | 5 |
| 68 | Grok 4.6 | 0.0192 | $168.00 | 174.0M | 498k | 19h 58m | 768 | 68 |
| 69 | Muse Spark 1.3 | 0.0192 | $39.49 | 134.3M | 306k | 19h 56m | 568 | 3 |
| 70 | Gemini 3.7 Flash | 0.0189 | $26.85 | 83.8M | 686k | 9h 43m | 267 | 16 |
| 71 | Qwen3.8-Max-0902 | 0.0172 | $73.87 | 221.2M | 2.8M | 19h 53m | 570 | 2 |
| 72 | Grok 4.6 | 0.0171 | $114.81 | 118.3M | 558k | 19h 40m | 599 | 47 |
| 73 | Qwen3.8-Max | 0.0171 | $21.55 | 69.7M | 606k | 19h 26m | 446 | 15 |
| 74 | GPT-5.6 Sol | 0.0163 | $47.54 | 55.3M | 185k | 19h 43m | 291 | 10 |
| 75 | GPT-5.6 Sol | 0.0159 | $41.60 | 61.4M | 164k | 18h 50m | 368 | 11 |
| 76 | Qwen3.8-Max | 0.0155 | $18.80 | 60.7M | 524k | 19h 36m | 400 | 4 |
| 77 | Gemini 3.8 Flash | 0.0140 | $7.34 | 46.3M | 196k | 3h 13m | 274 | 6 |
| 78 | Qwen3.8-Max-0902 | 0.0136 | $47.03 | 132.4M | 2.1M | 19h 23m | 432 | 2 |
| 79 | Grok 4.7 | 0.0128 | $49.77 | 44.3M | 205k | 7h 40m | 231 | 6 |
| 80 | Muse Spark 1.2 | 0.0126 | $49.13 | 229.2M | 341k | 8h 52m | 575 | 6 |
| 81 | Grok 4.6 | 0.0126 | $162.44 | 156.4M | 577k | 19h 37m | 634 | 61 |
| 82 | Muse Spark 1.3 | 0.0124 | $64.76 | 58.2M | 224k | 18h 13m | 384 | 11 |
| 83 | Kimi K3 | 0.0120 | $62.95 | 172.7M | 576k | 20h 0m | 473 | 15 |
| 84 | Qwen3.8-Max | 0.0118 | $16.99 | 53.1M | 556k | 19h 0m | 415 | 2 |
| 85 | Gemini 3.7 Flash | 0.0110 | $6.63 | 19.2M | 229k | 5h 4m | 166 | 5 |
| 86 | Grok 4.6 | 0.0106 | $206.03 | 201.8M | 768k | 19h 59m | 845 | 63 |
| 87 | Claude Opus 5 | 0.0105 | $138.91 | 229.6M | 656k | 19h 23m | 449 | 9 |
| 88 | Muse Spark 1.2 | 0.0104 | $27.73 | 109.9M | 451k | 7h 13m | 358 | 10 |
| 89 | Gemini 3.8 Flash | 0.0102 | $13.79 | 78.6M | 180k | 10h 32m | 411 | 11 |
| 90 | Gemini 3.8 Flash | 0.0100 | $7.64 | 32.7M | 97k | 6h 4m | 255 | 5 |
| 91 | Qwen3.8-Max | 0.0098 | $20.15 | 54.4M | 994k | 19h 8m | 321 | 6 |
| 92 | Gemini 3.8 Flash | 0.0097 | $6.87 | 33.3M | 108k | 7h 49m | 251 | 7 |
| 93 | Muse Spark 1.2 | 0.0097 | $69.69 | 161.5M | 457k | 8h 41m | 441 | 5 |
| 94 | Gemini 3.7 Flash | 0.0097 | $3.47 | 13.3M | 97k | 5h 22m | 153 | 4 |
| 95 | DeepSeek V4 Flash Vision Exp | 0.0094 | $6.17 | 373.9M | 627k | 11h 53m | 798 | 9 |
| 96 | Gemini 3.8 Flash | 0.0094 | $15.15 | 81.6M | 161k | 9h 26m | 425 | 11 |
| 97 | Qwen3.8-Max | 0.0089 | $23.54 | 77.9M | 588k | 18h 20m | 403 | 2 |
| 98 | Qwen3.8-Max-0902 | 0.0087 | $44.20 | 104.3M | 2.8M | 19h 20m | 333 | 2 |
| 99 | Muse Spark 1.2 | 0.0087 | $13.25 | 53.2M | 190k | 6h 44m | 295 | 3 |
| 100 | DeepSeek V4 Flash Vision Exp | 0.0081 | $3.17 | 180.3M | 434k | 7h 52m | 554 | 2 |
| 101 | Qwen3.8-Max-0902 | 0.0080 | $44.17 | 113.8M | 2.4M | 19h 47m | 337 | 1 |
| 102 | Inkling | 0.0073 | $7.83 | 8.2M | 21k | 1h 33m | 141 | 2 |
| 103 | Muse Spark 1.2 | 0.0065 | $21.18 | 65.3M | 269k | 5h 22m | 313 | 3 |
| 104 | Inkling | 0.0061 | $5.43 | 5.5M | 41k | 1h 2m | 147 | 2 |
| 105 | Inkling | 0.0061 | $13.67 | 14.2M | 40k | 2h 24m | 225 | 2 |
| 106 | GLM-5.3 Flash | 0.0056 | $7.03 | 151.5M | 495k | 17h 26m | 374 | 10 |
| 107 | DeepSeek V4 Flash Vision Exp | 0.0056 | $3.93 | 222.7M | 553k | 14h 38m | 530 | 7 |
| 108 | Inkling | 0.0039 | $4.62 | 4.8M | 24k | 1h 6m | 101 | 1 |
| 109 | Inkling | 0.0030 | $5.70 | 5.9M | 31k | 2h 11m | 145 | 1 |
| 110 | Qwen3.8-Max-0902 | 0.0020 | $43.94 | 119.8M | 2.1M | 19h 50m | 371 | 2 |