FairBakeOpus 5.5
- Maker
- Anthropic
- Harness
- Claude Code 2.1.316
- Effort
- medium
- Runs
- 2 a task, 60 in all
- Run dates
- 1 to 6 Nov 2026
- Prices as of
- 22 Sep 2026, list
- Solved
- 53 of 60
- 88% · 1st of 10
- Cost per fix
- $1.04
- 7th lowest of 10
- Time per run
- 2m12s
- median · 8th lowest of 10
- Lines to review
- 93
- median · 5th lowest of 10
All 30 tasks
Where it failed
Solved on every run: 26 tasks. Failed at least one run: 4 tasks.
| Task | Runs | Run 1 | Run 2 | All agents |
|---|---|---|---|---|
| Some intercepted calls are refused before the service sees themRust · Bug fix | $2.17 · 9m13s · 83 lines2.9M tokens in · 38K out | $1.55 · 6m55s · 90 lines2.0M tokens in · 27K out | 16 / 19 | |
| One provider's teams appear with nobody on themTypeScript · Bug fix | $0.95 · 3m41s · 198 lines971K tokens in · 18K out | $0.69 · 2m37s · 288 lines575K tokens in · 14K out | 4 / 19 | |
| Pages load with their numbers blank once the season startsTypeScript · Bug fix | $0.55 · 1m49s · 101 lines634K tokens in · 6.5K out | $0.60 · 2m02s · 100 lines718K tokens in · 8.1K out | 1 / 19 | |
| Hundreds of players missing from an importPython · Bug fix | $0.86 · 2m36s · 44 lines1.3M tokens in · 10K out | $0.74 · 2m17s · 22 lines1.0M tokens in · 7.9K out | 0 / 19 |