6 ms·
Shouldn’t these ‘malicious’ prompts be part of testing? If we are allowing scripts to be executed through prompts, shouldn’t there be more checks and balances?
by sherdil2022 1y ago
Shouldn’t these ‘malicious’ prompts be part of testing? If we are allowing scripts to be executed through prompts, shouldn’t there be more checks and balances?
“Don’t trust user input” “Validate user input” “Sanitize user input” mantras ring in my head.
Why weren’t they ringing in those developers heads? Or were they vibe coding??
Tongue firmly in cheek - or may be not.
- emseetech 1y agoProtecting against deterministic systems is hard enough, verbally defending against human language is an infinitely complex problem. The only reasonable way to prevent this is to firewall your services.
- sherdil2022 1y agoI agree. This is easier said than done. However, if a system is allowed to run scripts or arbitrary code without guard rails, all bets are off.