7 ms·
Gemini responds to request to turn on lights with hallucinated jailbreak prompt
- sd9 7mo agoConcerning for sure. This jailbreak comes as a “system” message, which will have more force than a "user" message. The user posted the full chat history below in the thread; they literally just asked to turn on the lights with a voice command [1]. [1] https://www.reddit.com/r/googlehome/comments/1qyvl8b/comment/o46r0sr/?utm_source=share&utm_medium=mweb3x&utm_name=mweb3xcss&utm_term=1&utm_content=share_button https://www.reddit.com/r/googlehome/comments/1qyvl8b/comment...
- armchairhacker 7mo agoOld voice assistant > User: “Turn on the damn light!” > AI: “Sorry, I’m not sure what you said” [needed the exact phrase “turn on the light”] New voice assistant > User: “Turn on the damn light!” > AI (thinking): “The user said to turn on the light. But they were rude and I’m feeling quirky today, so let’s run the shower instead.”
- cindyllm 7mo ago[dead]
- beardyw 7mo agoOpen the pod bay doors, HAL