I agree with Mitchell's original post: "stay frosty with AI", and I disagree with response that says "the houses are better". I'm assuming that Mitchell was say

I agree with Mitchell's original post: "stay frosty with AI", and I disagree with response that says "the houses are better". I'm assuming that Mitchell was saying you should treat all AI code with caution, and the more I work with AI-generated code, the more I agree with this sentiment. Even the frontier models (Fable, Opus, Sol, etc) all make fundamental errors from time to time, and if you're not keeping your eyes open these are easy to miss. Just the other day, I got Fable to help generate a sign-up flow for a Django app. It looked perfect to me, and like the Twitter post linked to, I looked at it with marvel and delight. But I got Sol to review the code and it spotted some fundamental issues with the flow that would have let bad actors enumerate accounts and log in before their account was verified - both of which were supposed to be checked. To continue with the analogy, yes we can "will houses into existence", but unless we've checked the bricks and the foundations, these houses can easily crumble into rubble.