6 ms·

People generating fake photos will just use an AI that doesn't leave a watermark. We are quickly approaching the point at which AI-generated and real images jus

People generating fake photos will just use an AI that doesn't leave a watermark. We are quickly approaching the point at which AI-generated and real images just cannot be distinguished, and we're going to have to adapt to that.

delusional 3y ago
There's value is raising the bar of difficulty, even if you don't make it completely impossible.
- danuker 3y ago
  I see a future where training a model without a watermark is illegal.
joshvm 3y ago
The other perspective is traceable cameras, such that you can have some guarantee that an image came from a particular device and wasn't AI-generated (e.g. your camera signs each image after capture). There have been attempts to cryptographically sign images, which have largely been broken, but the principle is there: https://www.dpreview.com/opinion/9955873926/why-cryptographically-signed-photos-matter https://www.dpreview.com/opinion/9955873926/why-cryptographi... See https://contentauthenticity.org/how-it-works https://contentauthenticity.org/how-it-works
- sebzim4500 3y ago
  If the plan is to trust every phone and camera manufacturer to keep their key safe then the plan is stupid. If the plan is to have a few trusted manufacturers for CCTV and police cameras than that might work, but will do little to combat misinformation.
hospitalJail 3y ago
>We are quickly approaching the point at which AI-generated and real images just cannot be distinguished Eh, there are so many ways where a large photo can fail. I'm obsessed with AI Art, but I think there will be human(or AI) detectors that will be paid to determine validity.
RobotToaster 3y ago
Or just use a watermark removing AI.
JohnFen 3y ago
> we're going to have to adapt to that. I don't see how we can without great harm. The only adaptation that I can see is to stop trusting in anything at all, and we're already dangerously far down that road as it is.
- CatWChainsaw 3y ago
  Yeah, a zero-trust society totally won't catastrophically implode, trust me bro.

delusional 3y ago

There's value is raising the bar of difficulty, even if you don't make it completely impossible.

danuker 3y ago
I see a future where training a model without a watermark is illegal.

joshvm 3y ago

The other perspective is traceable cameras, such that you can have some guarantee that an image came from a particular device and wasn't AI-generated (e.g. your camera signs each image after capture). There have been attempts to cryptographically sign images, which have largely been broken, but the principle is there: https://www.dpreview.com/opinion/9955873926/why-cryptographically-signed-photos-matter https://www.dpreview.com/opinion/9955873926/why-cryptographi... See https://contentauthenticity.org/how-it-works https://contentauthenticity.org/how-it-works

sebzim4500 3y ago
If the plan is to trust every phone and camera manufacturer to keep their key safe then the plan is stupid. If the plan is to have a few trusted manufacturers for CCTV and police cameras than that might work, but will do little to combat misinformation.

hospitalJail 3y ago

>We are quickly approaching the point at which AI-generated and real images just cannot be distinguished Eh, there are so many ways where a large photo can fail. I'm obsessed with AI Art, but I think there will be human(or AI) detectors that will be paid to determine validity.

RobotToaster 3y ago

Or just use a watermark removing AI.

JohnFen 3y ago

> we're going to have to adapt to that. I don't see how we can without great harm. The only adaptation that I can see is to stop trusting in anything at all, and we're already dangerously far down that road as it is.

CatWChainsaw 3y ago
Yeah, a zero-trust society totally won't catastrophically implode, trust me bro.