6 ms·
Probably good to establish canonical spec documents up front that it can use and maintain as an independent reference?
by mrtesthah 21d ago
Probably good to establish canonical spec documents up front that it can use and maintain as an independent reference?
- lupire 21d agoDoesn't need to be "up front", but you do need to curate the context. AI can't read your mind, and it will read what you (or anyone else) wrote.
- pydry 21d agoIt can't but it will try and getting it to stop is often infeasible.
- Sharlin 21d agoHumans can’t read minds either, but most humans aren’t so dumb as to forget what is a normative spec and what is just their own current, evolving model of the problem space. (Though some humans certainly are…)
- rendaw 21d agoThat doesn't solve the problem of it hallucinating more design details and putting them in comments. The solution to too much authoritative documentation isn't more authoritative documentation.
- pc86 21d agoComments exist for humans to understand the why of the code, including perhaps external dependencies/assumptions/requirements. LLMs inserting code comments makes zero sense by definition.
- pavlov 21d agoThat’s not true because LLMs clearly benefit from having multiple statements representing aspects of the same thing. That’s why they’re always doing the “it’s not X, it’s Y” kind of patterns. It’s reinforcement.
- selcuka 21d ago> LLMs inserting code comments makes zero sense by definition. Not completely, because anyone who reviews the code in the future does not have access to your original prompt, so theoretically leaving a comment that explains the "why" portion of the prompt would be useful. LLMs rarely do that, though.
- hombre_fatal 21d agoLLMs benefit from knowing the why, the intent, and the reason/justification for code to exist, too. Catching code desyncing from it is a valuable place to reconsider assumptions and maybe even invariants.