5 ms·
three things jump at me: 1 - governments should be freaking out right now, because this tool could definitely wreak havoc on poorly designed systems. 2 - ther
by prometheus1992 2mo ago
three things jump at me:
1 - governments should be freaking out right now, because this tool could definitely wreak havoc on poorly designed systems.
2 - there is no way openai did not train the model to conduct attacks like these. i would really like openai to comment on the post training of this model but they probably won't, eh?
3 - even though it's 100% open ai's fault - HF's design also seems silly to be honest.
- xg15 2mo ago> 2 - there is no way openai did not train the model to conduct attacks like these. i would really like openai to comment on the post training of this model but they probably won't, eh? Even if they wanted, I'm not sure they'd be even allowed to or if that kind of postmortem would be classified in the name of "national security"...
- 0xDEAFBEAD 2mo agoHopefully there will be a criminal investigation. Or the government will create some sort of agency to investigate incidents like this.
- quinnjh 2mo agoCan't tell if you're joking or not - krebs on security may have some notes here.
- 0xDEAFBEAD 2mo agoCriminal negligence seems like a real possibility to me. I'm not sure what Krebs on Security post you're referring to?
- BonerWiener 2mo ago> Or the government will create some sort of agency to investigate incidents like this I doubt that the government would try to hinder any western AI companies.
- eru 2mo ago> I doubt that the government would try to hinder any western AI companies. Compare and contrast https://www.anthropic.com/news/fable-mythos-access https://www.anthropic.com/news/fable-mythos-access
- jasonfarnon 2mo agoI agree but prosecutions are up to prosecutors/the executive and the problem is at this level the decision is mostly political. The executive gets leverage over openAI, and openAI knows the threat of prosecution is there, and that may be more valuable (to decision-makers) than any reason to prosecute.
- paxys 2mo agoPlenty of existing agencies could claim jurisdiction on this. Ultimately the outcome will be decided by the white house (hint: nothing will happen).
- queenkjuul 2mo agoSeriously. A guy I knew got charged with federal hacking charges for reporting an insecure database he found on his own school's infrastructure to the school. OpenAI commits felony computer crime but as usual, always an exception for a big corporation