7 ms·
The LLM likely does not have write access to the database, so even if wanted to run that query it couldn't.
by returningfory2 1y ago
The LLM likely does not have write access to the database, so even if wanted to run that query it couldn't.
- mschuster91 1y agoFigured as much, anyone opening a database to any sort of potentially hostile input should know to restrict the permissions. I'm more focused on the AI side of things. Like, if it's done as a part of the (system) prompt, it should eventually be possible to evict the command tokens when the context window becomes too large?
- returningfory2 1y agoOr is it possible the LLM did try to run `DELETE FROM hackernews.full`, was denied, and then is prompted to return the response you saw?
- mschuster91 1y agoThe error message came instantaneously, plus when asking a "legitimate" input ("what does user mschuster91 write about") it not just struggled to write legitimate SQL but explicitly said so in its response, so I think this is either seriously reinforced during training to not ever run a DELETE or otherwise destructive operation or there's some sort of firewall.