5 ms·

Users showed that Gemini and openAI also undress people, it’s not just grok.

emilfihlman 8mo ago
Yeah the reason Google and OpenAI etc are silent is because their services do the same but they "aren't the bad guys" so if they shut up the crisis will pass. This of course implies that the crisis itself and persecution of Musk/Grok is politically motivated, or just based on stupidity.
- mirabilis 8mo ago
  The same capabilities might be present in many available models, but I do think that the public/social aspect in usage is quite different— people can’t come into my Google account and save nudified versions of my family photos directly to my Google drive, but X generated a lot of attention because the users are directly replying or quoting other users and @ing them with the modified photos.
hn_throwaway_99 8mo ago
Can you provide a link with evidence of that? I haven't seen that reported. I'd also note in advance there is a big difference in someone figuring out how to jailbreak Gemini or OpenAI, and then the companies responding swiftly to fix that, than what has been reported with Grok where it was basically wide open to create those images.
- Amezarak 8mo ago
  Grok has never been "wide open" to undress people. Anyone reporting that is being extremely duplicitous. Any image-to-image on Grok has stringent NSFW filters for exactly this scenario. People have worked out jailbreaks and those get dealt with.
  - hnburnsy 8mo ago
    https://www.wired.com/story/google-and-openais-chatbots-can-strip-women-in-photos-down-to-bikinis/ https://www.wired.com/story/google-and-openais-chatbots-can-... https://hub.jhu.edu/2023/11/01/nsfw-ai/ https://hub.jhu.edu/2023/11/01/nsfw-ai/ https://www.linkedin.com/posts/shubhank-suman-7995741b4_investigative-report-shubhank-suman-activity-7414555686392627200-SAiL https://www.linkedin.com/posts/shubhank-suman-7995741b4_inve... https://old.reddit.com/r/GeminiAI/comments/1oxrcd2/gemini_25_pro_is_completely_uncensored_if_you/ https://old.reddit.com/r/GeminiAI/comments/1oxrcd2/gemini_25...
    - Amezarak 8mo ago
      Yes, all those articles are about people getting around the safeguards in different AI.
      - hnburnsy 8mo ago
        Sorry was replying to your parent comment about evidence that other AIs had the same issue
ctoth 8mo ago
This is such a weird issue for me, who is blind. Did Grok undress people, or did Grok show extrapolated images of what people might look like undressed? The "undressed people" framing makes it sound like people physically had their clothes removed. Obviously this did not happen. But, like. If I have like ... a mole somewhere under my clothes, Grok cannot know about that right? People will know what they themselves look like naked? Someone looking at Grok's output learns literally nothing about what the actual person looks like naked, right? Kinda sounds like somebody should just make something that creates this for every picture ever? Then everybody has a defense -- "fake nudes!" and the pictures are meaningless?
- Amezarak 8mo ago
  This is the sort of thing that is technically correct, but misses the emotional aspect that people want to be able to control their public perception. Of course people could (and did) do this with older tools or by hand. It doesn't matter to them. And since Elon/X are the villain du jour, it's a good lever to punish them.
- bryanrasmussen 8mo ago
  >If I have like ... a mole somewhere under my clothes, Grok cannot know about that right? unless some ex spoke about that gross mole you had in twitter or some data that was scraped somewhere, no. Not sure what the actual odds are of it knowing if you have a mole or not.
  - ctoth 8mo ago
    Use the mole example as referring to any physical characteristic hidden by clothing that people want to remain hidden. It's an example to demonstrate that the AI is not "undressing" anybody. It is filling in an extrapolation of pixels which have no clear relationship to the underlying reality. If you have a hidden tattoo, that tattoo is still not visible. This gets fuzzy because literally everything is correlated -- it may be possible to infer that you are the type of person who might have a tattoo there? But grok doesn't have access to anything that hasn't already been shared. Grok is not undressing anybody, the people using it to generate these images aren't undressing anybody, they are generating fake nudes which have no more relationship to reality than someone taking your public blog posts and then attempting to write a post in your voice.
wasabi991011 8mo ago
Gemini and ChatGPT conversations are private, not public. A big part of the controversy over Grok is that it's happening in public on Twitter, often as direct replies to the user who's picture is being manipulated.

Yeah the reason Google and OpenAI etc are silent is because their services do the same but they "aren't the bad guys" so if they shut up the crisis will pass. This of course implies that the crisis itself and persecution of Musk/Grok is politically motivated, or just based on stupidity.

mirabilis 8mo ago
The same capabilities might be present in many available models, but I do think that the public/social aspect in usage is quite different— people can’t come into my Google account and save nudified versions of my family photos directly to my Google drive, but X generated a lot of attention because the users are directly replying or quoting other users and @ing them with the modified photos.

hn_throwaway_99 8mo ago

Can you provide a link with evidence of that? I haven't seen that reported. I'd also note in advance there is a big difference in someone figuring out how to jailbreak Gemini or OpenAI, and then the companies responding swiftly to fix that, than what has been reported with Grok where it was basically wide open to create those images.

Amezarak 8mo ago
Grok has never been "wide open" to undress people. Anyone reporting that is being extremely duplicitous. Any image-to-image on Grok has stringent NSFW filters for exactly this scenario. People have worked out jailbreaks and those get dealt with.
- hnburnsy 8mo ago
  https://www.wired.com/story/google-and-openais-chatbots-can-strip-women-in-photos-down-to-bikinis/ https://www.wired.com/story/google-and-openais-chatbots-can-... https://hub.jhu.edu/2023/11/01/nsfw-ai/ https://hub.jhu.edu/2023/11/01/nsfw-ai/ https://www.linkedin.com/posts/shubhank-suman-7995741b4_investigative-report-shubhank-suman-activity-7414555686392627200-SAiL https://www.linkedin.com/posts/shubhank-suman-7995741b4_inve... https://old.reddit.com/r/GeminiAI/comments/1oxrcd2/gemini_25_pro_is_completely_uncensored_if_you/ https://old.reddit.com/r/GeminiAI/comments/1oxrcd2/gemini_25...
  - Amezarak 8mo ago
    Yes, all those articles are about people getting around the safeguards in different AI.
    - hnburnsy 8mo ago
      Sorry was replying to your parent comment about evidence that other AIs had the same issue

ctoth 8mo ago

This is such a weird issue for me, who is blind. Did Grok undress people, or did Grok show extrapolated images of what people might look like undressed? The "undressed people" framing makes it sound like people physically had their clothes removed. Obviously this did not happen. But, like. If I have like ... a mole somewhere under my clothes, Grok cannot know about that right? People will know what they themselves look like naked? Someone looking at Grok's output learns literally nothing about what the actual person looks like naked, right? Kinda sounds like somebody should just make something that creates this for every picture ever? Then everybody has a defense -- "fake nudes!" and the pictures are meaningless?

Amezarak 8mo ago
This is the sort of thing that is technically correct, but misses the emotional aspect that people want to be able to control their public perception. Of course people could (and did) do this with older tools or by hand. It doesn't matter to them. And since Elon/X are the villain du jour, it's a good lever to punish them.
bryanrasmussen 8mo ago
>If I have like ... a mole somewhere under my clothes, Grok cannot know about that right? unless some ex spoke about that gross mole you had in twitter or some data that was scraped somewhere, no. Not sure what the actual odds are of it knowing if you have a mole or not.
- ctoth 8mo ago
  Use the mole example as referring to any physical characteristic hidden by clothing that people want to remain hidden. It's an example to demonstrate that the AI is not "undressing" anybody. It is filling in an extrapolation of pixels which have no clear relationship to the underlying reality. If you have a hidden tattoo, that tattoo is still not visible. This gets fuzzy because literally everything is correlated -- it may be possible to infer that you are the type of person who might have a tattoo there? But grok doesn't have access to anything that hasn't already been shared. Grok is not undressing anybody, the people using it to generate these images aren't undressing anybody, they are generating fake nudes which have no more relationship to reality than someone taking your public blog posts and then attempting to write a post in your voice.

wasabi991011 8mo ago

Gemini and ChatGPT conversations are private, not public. A big part of the controversy over Grok is that it's happening in public on Twitter, often as direct replies to the user who's picture is being manipulated.