6 ms·
My newest open source project[1] is ~90% written by LLM, but I work in the field so there is a chance my ability to manipulate LLMs is above average. It is als
by devbent 2y ago
My newest open source project[1] is ~90% written by LLM, but I work in the field so there is a chance my ability to manipulate LLMs is above average.
It is also a tiny project, just a single microservice, although my upcoming open source project is fairly substantial and I suspect it'll be at least 30% LLM generated.
The fact is LLMs are really good at generating chunks of code, sometimes even entire files, but they aren't that good at making systematic changes to large swaths of existing code. They can be made to work for that scenario with tons of prompt engineering and prompt chaining, but that isn't where LLMs shine.
For example almost all of the HTML in that project was made by Claude. I then modified the code and re-uploaded it and asked Claude to add collapsible info boxes to parts of the page after the fact, and Claude completely failed at the task.
Still though I am seeing an incredible increase in my development velocity.
[1] https://www.github.com/devlinb/escaperoom https://www.github.com/devlinb/escaperoom -ugly UI, designed to help people create escape rooms for LLMs. A hosted version will be up later today!