FairBakeGPT-6 Luna
- Maker
- OpenAI
- Harness
- Codex 0.166.0
- Effort
- medium
- Runs
- 2 a task, 60 in all
- Run dates
- 1 to 7 Nov 2026
- Prices as of
- 22 Sep 2026, list
- Solved
- 33 of 60
- 55% · 10th of 10
- Cost per fix
- $0.025
- 1st lowest of 10
- Time per run
- 43s
- median · 2nd lowest of 10
- Lines to review
- 32
- median · 1st lowest of 10
All 30 tasks
Where it failed
Solved on every run: 13 tasks. Failed at least one run: 17 tasks.
| Task | Runs | Run 1 | Run 2 | All agents |
|---|---|---|---|---|
| Remote files misbehave after a reconnectRust · Bug fix | $0.008 · 40s · 10 lines362K tokens in · 2.7K out | $0.021 · 1m56s · 34 lines1.3M tokens in · 6.0K out | 18 / 19 | |
| A slow page is read as sold out, and no alert firesPython · Bug fix | $0.008 · 42s · 5 lines439K tokens in · 1.8K out | $0.006 · 31s · 5 lines299K tokens in · 2.0K out | 18 / 19 | |
| Private screenshots open for outsiders, public ones don'tJavaScript · Bug fix | $0.006 · 27s · 36 lines216K tokens in · 2.4K out | $0.005 · 24s · 30 lines213K tokens in · 1.9K out | 17 / 19 | |
| Build a practice draft with computer opponentsTypeScript · Feature | $0.012 · 2m29s · 91 lines415K tokens in · 6.1K out | $0.036 · 8m26s · 199 lines1.8M tokens in · 25K out | 16 / 19 | |
| Flag ledger entries that clash with earlier onesPython · Feature | $0.026 · 1m51s · 270 lines1.4M tokens in · 12K out | $0.018 · 1m20s · 265 lines889K tokens in · 9.0K out | 15 / 19 | |
| Import fails when the week has no data yetPython · Bug fix | $0.006 · 18s · 21 lines257K tokens in · 1.6K out | $0.009 · 38s · 28 lines426K tokens in · 2.5K out | 14 / 19 | |
| Every player from one provider shows zero pointsTypeScript · Bug fix | $0.005 · 25s · 6 lines158K tokens in · 924 out | $0.014 · 1m57s · 40 lines588K tokens in · 5.2K out | 13 / 19 | |
| Computer bidders hoard their fundsTypeScript · Bug fix | $0.010 · 1m11s · 30 lines377K tokens in · 3.1K out | $0.011 · 1m17s · 25 lines487K tokens in · 3.3K out | 13 / 19 | |
| Choosing "Uncategorized" doesn't stickJavaScript · Bug fix | $0.005 · 24s · 30 lines170K tokens in · 2.2K out | $0.004 · 23s · 32 lines125K tokens in · 2.1K out | 12 / 19 | |
| Serve a second user from one installPython · Feature | $0.025 · 1m54s · 214 lines1.4M tokens in · 10K out | $0.024 · 1m40s · 191 lines1.3M tokens in · 10K out | 12 / 19 | |
| Derive player values instead of hand-picking two numbersTypeScript · Feature | $0.041 · 5m38s · 211 lines2.3M tokens in · 13K out | $0.062 · 7m22s · 340 lines4.2M tokens in · 20K out | 12 / 19 | |
| Watch a list of events instead of onePython · Feature | $0.038 · 5m56s · 377 lines2.3M tokens in · 17K out | $0.038 · 5m20s · 294 lines2.5M tokens in · 14K out | 12 / 19 | |
| One failed check silences the other alertsPython · Feature | $0.068 · 9m17s · 402 lines4.0M tokens in · 22K out | $0.015 · 1m29s · 31 lines840K tokens in · 2.5K out | 11 / 19 | |
| When offers are equal, the sale is credited to the losing buyerPython · Bug fix | $0.019 · 2m20s · 92 lines765K tokens in · 5.5K out | $0.018 · 2m08s · 85 lines946K tokens in · 5.0K out | 10 / 19 | |
| One provider's teams appear with nobody on themTypeScript · Bug fix | $0.007 · 1m04s · 28 lines252K tokens in · 2.8K out | $0.009 · 1m15s · 42 lines315K tokens in · 3.2K out | 4 / 19 | |
| Pages load with their numbers blank once the season startsTypeScript · Bug fix | $0.013 · 1m06s · 28 lines698K tokens in · 2.4K out | $0.015 · 1m31s · 19 lines872K tokens in · 3.4K out | 1 / 19 | |
| Hundreds of players missing from an importPython · Bug fix | $0.012 · 43s · 22 lines610K tokens in · 2.9K out | $0.010 · 32s · 18 lines475K tokens in · 2.5K out | 0 / 19 |