GPT-6.1 Sol
- Maker
- OpenAI
- Harness
- Codex 0.166.0
- Effort
- low
- Runs
- 2 a task, 60 in all
- Run dates
- 1 to 7 Nov 2026
- Prices as of
- 29 Sep 2026, list
- Solved
- 48 of 60
- 80% · 5th of 10
- Cost per fix
- $0.28
- 5th lowest of 10
- Time per run
- 1m55s
- median · 7th lowest of 10
- Lines to review
- 148
- median · 8th lowest of 10
All 30 tasks
Where it failed
Solved on every run: 23 tasks. Failed at least one run: 7 tasks.
| Task | Runs | Run 1 | Run 2 | All agents |
|---|---|---|---|---|
| Choosing "Uncategorized" doesn't stickJavaScript · Bug fix | $0.16 · 1m39s · 306 lines316K tokens in · 6.1K out | $0.20 · 3m00s · 302 lines347K tokens in · 7.8K out | 12 / 19 | |
| Serve a second user from one installPython · Feature | $0.25 · 2m49s · 572 lines562K tokens in · 9.2K out | $0.28 · 4m21s · 615 lines616K tokens in · 10K out | 12 / 19 | |
| Derive player values instead of hand-picking two numbersTypeScript · Feature | $0.44 · 7m18s · 414 lines1.7M tokens in · 14K out | $0.40 · 5m23s · 473 lines1.3M tokens in · 13K out | 12 / 19 | |
| One failed check silences the other alertsPython · Feature | $0.72 · 14m39s · 1397 lines2.7M tokens in · 27K out | $0.82 · 12m03s · 1454 lines3.0M tokens in · 31K out | 11 / 19 | |
| One provider's teams appear with nobody on themTypeScript · Bug fix | $0.21 · 3m11s · 229 lines536K tokens in · 8.1K out | $0.13 · 1m53s · 125 lines324K tokens in · 3.9K out | 4 / 19 | |
| Pages load with their numbers blank once the season startsTypeScript · Bug fix | $0.29 · 2m57s · 142 lines838K tokens in · 6.8K out | $0.20 · 2m14s · 155 lines617K tokens in · 4.6K out | 1 / 19 | |
| Hundreds of players missing from an importPython · Bug fix | $0.39 · 4m39s · 517 lines1.5M tokens in · 11K out | $0.66 · 8m22s · 450 lines2.8M tokens in · 21K out | 0 / 19 |