7 ms·
Exactly! Attempting to handle prompt injections by prompting the model (not to leak sensitive data), is like attempting to stop a fire by burning the area arou
by catoc 2mo ago
Exactly!
Attempting to handle prompt injections by prompting the model (not to leak sensitive data), is like attempting to stop a fire by burning the area around it
- politician 2mo agoMy guy, that's actually how fires are stopped. https://en.wikipedia.org/wiki/Firebreak https://en.wikipedia.org/wiki/Firebreak https://en.wikipedia.org/wiki/Controlled_burn https://en.wikipedia.org/wiki/Controlled_burn
- catoc 2mo agoHaha, nice. TIL. So all we need is ‘controlled prompting’ to handle prompt injections :-)
- NateEag 2mo agoIt's maybe closer to putting a sign saying "The door is locked" on an unlocked bank vault. It does nothing to improve security, and if someone manages to get inside and see the sign (i.e. "extract the prompt"), it gives them a strong hint there's interesting stuff behind this door.