FairBakeGPT-6 Astra
- Maker
- OpenAI
- Harness
- Codex 0.166.0
- Effort
- low
- Runs
- 2 a task, 60 in all
- Run dates
- 1 to 7 Nov 2026
- Prices as of
- 9 Sep 2026, list
- Solved
- 50 of 60
- 83% · 3rd of 10
- Cost per fix
- $1.76
- 8th lowest of 10
- Time per run
- 2m16s
- median · 9th lowest of 10
- Lines to review
- 199
- median · 10th lowest of 10
All 30 tasks
Where it failed
Solved on every run: 24 tasks. Failed at least one run: 6 tasks.
| Task | Runs | Run 1 | Run 2 | All agents |
|---|---|---|---|---|
| Choosing "Uncategorized" doesn't stickJavaScript · Bug fix | $0.73 · 1m35s · 274 lines269K tokens in · 5.4K out | $0.90 · 1m44s · 196 lines303K tokens in · 5.1K out | 12 / 19 | |
| Serve a second user from one installPython · Feature | $1.57 · 3m29s · 629 lines583K tokens in · 9.7K out | $1.45 · 4m40s · 655 lines486K tokens in · 9.9K out | 12 / 19 | |
| Derive player values instead of hand-picking two numbersTypeScript · Feature | $2.98 · 7m46s · 578 lines1.7M tokens in · 14K out | $3.13 · 6m51s · 569 lines1.5M tokens in · 17K out | 12 / 19 | |
| One provider's teams appear with nobody on themTypeScript · Bug fix | $0.97 · 2m10s · 135 lines410K tokens in · 4.6K out | $1.48 · 3m24s · 201 lines716K tokens in · 7.0K out | 4 / 19 | |
| Pages load with their numbers blank once the season startsTypeScript · Bug fix | $1.56 · 3m11s · 186 lines762K tokens in · 5.4K out | $2.27 · 4m06s · 316 lines1.1M tokens in · 9.3K out | 1 / 19 | |
| Hundreds of players missing from an importPython · Bug fix | $2.89 · 6m02s · 699 lines1.5M tokens in · 13K out | $3.66 · 10m51s · 310 lines2.0M tokens in · 18K out | 0 / 19 |