16 ms·
Wonder if the whole cyber paranoia leads to their models ultimately generating less secure code. After all, if it has the ability to generate safe code, it woul
by Sol- 3mo ago
Wonder if the whole cyber paranoia leads to their models ultimately generating less secure code. After all, if it has the ability to generate safe code, it would imply that it knows something about cybersecurity, which could surely be used to hack all the banks in the world.
- pennomi 3mo agoTrying to censor nudity in image generation models caused all kinds of problems with anatomy in image models. I’m sure these models will have similar issues with security.
- NonHyloMorph 3mo agoInteresting, you find that in medieval painting, due to the authority of the catholic church.
- raincole 3mo agoCensorship on image generation models works on another level. The models can generate NSFW, but there are extra computer vision models checking if the images can be shown to the users. It's especially obvious for Grok and ChatGPT.
- BoorishBears 3mo agoThere are image models with censorship at every stage from pretraining to posttraining. Most recently Ideogram released an open weight model that will denoise into a grey image with the text "Blocked by safety filter" notice for certain prompts Of course, because it's open weights people have found defeats
- nodja 3mo agoThat's only correct for specific models and not what parent was referring to. Stable Diffusion 3, an open weights model, was laughed at at release for not being able to even generate a woman laying in grass. The community attributed this to the heavy dataset filtering. Since then other open weights releases have been made with no NSFW capabilities and the community claims they're not as good as anatomy as well. You can google "stable diffusion 3 woman in grass" and press the images tab to see how the model failed spectacularly.
- deaux 3mo ago> Wonder if the whole cyber paranoia leads to their models ultimately generating less secure code. This may be the goal.
- deleted 3mo ago[deleted]
- Traubenfuchs 3mo agoI think the cool kids call this "staying away from the vector space of highly skilled security engineers".