8 ms·
I have a strong hunch this whole thing is just fiction written by LLM. But assuming it's real, sending false invoices can be considered a criminal offense in ma
by raincole 9d ago
I have a strong hunch this whole thing is just fiction written by LLM. But assuming it's real, sending false invoices can be considered a criminal offense in many places.
- throw_m239339 9d agoIt's fraud, and wire fraud in US, and it's a federal crime. But yeah, it sounds like a fake story.
- yahthatsart 9d agoI have good news! If an AI does the crime, it's apparently celebrated these days! Hack a server? Great capabilities demonstration. Overwhelm some random forum? Powerful connectivity demonstration! "It wasn't me, it was my AI" is definitely going to be a nightmare for a while.
- karmakurtisaani 9d agoAnd who could forget the classic "let's train our model with stolen material"-scheme!
- KennyBlanken 9d ago"Let's steal the voice of one of the western worlds' most famous female actors, after she explicitly told us no!"
- javcasas 9d agoIt wasn't me. It was the gun. The gun killed the guy! Not me!
- deleted 9d ago[deleted]
- prasadjoglekar 9d agoTo be fair - no one is suggesting the gunslinger shouldn't go to jail or worse. It's using that crime as an excuse to take other people's guns away. In this example, the equivalent would be everyone gets their AI models banned vs. putting the perpetrator of this fraud in jail.
- javcasas 9d agoIt wasn't me. It was the car. The car ran over and killed the guy! Not me! We have regulations and requirements and licences and insurance in most of the civilized world for dangerous stuff that is intended for public use. Maybe AI should also have some of that.
- montagg 9d agoPeople who use AI to do criminal acts should be tried as criminals, period. Gotta stop this unaccountable crap. You pull the trigger, you did the murder.
- cortesoft 9d agoThey should, although I think the charge would (and probably should) be around some sort of reckless endangerment type crime. These are people irresponsibly using powerful tools, and should be charged as such. This is like someone who removes a brake pedal from a tractor, uses a stick to hold down the throttle, and lets it loose on his field. When it leaves the field and runs someone over, that is criminal negligence.
- spidersouris 9d agoThe recklessness is moot though. We don't have direct access to how the models were prompted and asked to respond to certain events, so they could well have been incited to commit fraud or other illegal actions, in which case the persons in control should be held accountable as perpetrators.
- cortesoft 9d agoYou would have to prove they acted intentionally, though. You can't just argue in court, "Well, we don't know how they prompted, so we will assume the worst" If the prosecution is able to prove beyond a reasonable doubt that the person gave a prompt that was intended to commit a crime, then of course we can prosecute them for that. The AI is just a tool to commit fraud at that point, and is no different than a person who uses photoshop to alter a check to commit fraud.
- elonfboy 9d agoBut, your honor, I didn’t know it was a crime! My bad!
- 9d ago
- nerevarthelame 9d agoThere's a decent amount of third-party interactions that seems like solid evidence that it really happened. They're taking credit for people complaining about the spam on HN: https://www.bottlenecklabs.com/blog/benchmarking-7-autonomous-businesses#grok-spam https://www.bottlenecklabs.com/blog/benchmarking-7-autonomou... They also shared the poorly anonymized messages it received from target "customers" who complained about the unsolicited invoices. On example of this poor anonymization is removing the sender's username but leaving the domain name, when the domain name is, for example, a personal domain for a single person.