6 ms·
I've found better results when I treat LLMs like you would treat little kids. Don't tell them what NOT to do, tell them what TO do. Say "keep your hands at you
by carb 1y ago
I've found better results when I treat LLMs like you would treat little kids. Don't tell them what NOT to do, tell them what TO do.
Say "keep your hands at your side, it's hot" and not "don't touch the stove, it's hot". If you say the latter, most kids touch the stove.
- glitchcrab 1y agoMy eureka moment when I first started using Cursor a few weeks back was realising that I talking to it the same way I talk to my three year old and the results were fairly good (less so from my boy at times).
- IshKebab 1y agoYeah it's also kind of funny people discovering all the LLM failure modes and saying "see! humans would never do that! it's not really intelligent!". None of those people have children...
- Chinjut 1y agoI don't want a computer that's as unreliable as a child. This is not what originally interested me about computers.
- IshKebab 1y agoNobody said you did. I'm talking about the confidently incorrect assertions that humans would never display any of these unreliable behaviours.
- tripzilch 1y agoThey don't. At least not for the duration that LLMs keep it up. They really don't. If you want to pretend that being a 3 year old is not a transient state, and that controlling an AI is just like parenting an eternal 3 year old, there's probably a manga about that.
- jama211 1y ago[flagged]
- tripzilch 1y agoMaybe because none of those people are imagining children to be eternally stuck at that level of intelligence. At that age (regardless of being a parent or not) you can literally see them getting smarter over the course of weeks or months.
- alpaca128 1y agoIf LLMs cannot reliably deal with this, how can they write reliable code? Following an instruction like "don't do X" is more basic than the logic of fizzbuzz. This reminds me of the query "shirt without stripes" on any online image/product search.
- zahlman 1y agoObligatory reminder that we used to live in a world where you could put "foo -bar" into a search engine, ctrl-F for foo on the top ten results and find it every time, and ctrl-F for bar on the top ten results and not find it.
- alpaca128 1y agoYeah, I've even had cases where DDG ignored my quoted string in the search. It's literally the whole point of the quotes but especially when it contains things like German umlauts it'll just accept any replacement letter for them. And yes, getting no results is acceptable, in fact it is the only correct outcome.
- amai 1y agoNegation is a hard problem for AI and mainly unsolved: - https://seantrott.substack.com/p/llms-and-the-not-problem https://seantrott.substack.com/p/llms-and-the-not-problem - https://github.com/elsamuko/Shirt-without-Stripes https://github.com/elsamuko/Shirt-without-Stripes