Thinking about the code I’ve written over the last quarter century I’d wager that a majority of it was somewhere between mediocre and bad. Some is good and a very small bit is actually exceptional. I think that’s a pretty common rating of our output.

This is what coding LLM learn from. No one is selective and only trains on the most elite code ever written. Nope, just the buggy stuff we all put up on Github. So of course these LLMs are gonna be writing junk code half the time.