FairBakeGLM-5.3 Flash
- Maker
- Z.ai
- Harness
- pi 1.4.0
- Effort
- high
- Runs
- 2 a task, 60 in all
- Run dates
- 1 to 6 Nov 2026
- Prices
- as charged
- Solved
- 41 of 60
- 68% · 9th of 10
- Cost per fix
- $0.078
- 3rd lowest of 10
- Time per run
- 1m49s
- median · 5th lowest of 10
- Lines to review
- 138
- median · 6th lowest of 10
All 30 tasks
Where it failed
Solved on every run: 18 tasks. Failed at least one run: 12 tasks.
| Task | Runs | Run 1 | Run 2 | All agents |
|---|---|---|---|---|
| An expired session makes a button hangJavaScript · Bug fix | $0.007 · 30s · 36 lines150K tokens in · 3.8K out | $0.024 · 1m37s · 29 lines506K tokens in · 16K out | 17 / 19 | |
| Server takes traffic after a failed startupPython · Bug fix | $0.059 · 3m06s · 94 lines1.4M tokens in · 29K out | $0.021 · 2m01s · 74 lines341K tokens in · 21K out | 17 / 19 | |
| Build a practice draft with computer opponentsTypeScript · Feature | $0.088 · 7m36s · 769 lines1.8M tokens in · 70K out | $0.23 · 31m50s · 673 lines5.9M tokens in · 101K out | 16 / 19 | |
| Flag ledger entries that clash with earlier onesPython · Feature | $0.086 · 3m30s · 960 lines2.2M tokens in · 35K out | $0.095 · 3m34s · 1132 lines2.5M tokens in · 38K out | 15 / 19 | |
| Import fails when the week has no data yetPython · Bug fix | $0.011 · 53s · 69 lines222K tokens in · 6.0K out | $0.012 · 1m01s · 80 lines229K tokens in · 7.0K out | 14 / 19 | |
| Every player from one provider shows zero pointsTypeScript · Bug fix | $0.011 · 55s · 28 lines228K tokens in · 4.9K out | $0.016 · 1m13s · 72 lines325K tokens in · 9.8K out | 13 / 19 | |
| Watch a list of events instead of onePython · Feature | $0.049 · 2m28s · 387 lines1.1M tokens in · 27K out | $0.074 · 3m13s · 673 lines1.9M tokens in · 32K out | 12 / 19 | |
| One failed check silences the other alertsPython · Feature | $0.16 · 5m36s · 1229 lines4.3M tokens in · 59K out | $0.16 · 4m54s · 1659 lines4.1M tokens in · 55K out | 11 / 19 | |
| When offers are equal, the sale is credited to the losing buyerPython · Bug fix | $0.037 · 1m56s · 297 lines881K tokens in · 17K out | $0.027 · 1m37s · 290 lines549K tokens in · 17K out | 10 / 19 | |
| One provider's teams appear with nobody on themTypeScript · Bug fix | $0.067 · 4m57s · 433 lines1.7M tokens in · 26K out | $0.084 · 5m13s · 191 lines2.0M tokens in · 43K out | 4 / 19 | |
| Pages load with their numbers blank once the season startsTypeScript · Bug fix | $0.032 · 2m49s · 36 lines765K tokens in · 14K out | $0.026 · 1m27s · 92 lines600K tokens in · 11K out | 1 / 19 | |
| Hundreds of players missing from an importPython · Bug fix | $0.12 · 4m30s · 310 lines3.2M tokens in · 34K out | $0.12 · 4m40s · 317 lines3.2M tokens in · 40K out | 0 / 19 |