7 ms·

What this says to me is OpenAI is a bunch of yahoos who don't understand the basic concept of an air gap.

• ipsum2 14d ago
  I'm sure they all do. Whether an air gap is warranted is evidently less obvious.
  • andxor 14d ago
    It's patently obvious at this point.
    • bpodgursky 14d ago
      The models are going to be released to users who have internet access, you can't even do safety evals without internet. Not saying OpenAI did a good job monitoring here, but it's not avoidable.
      • andxor 14d ago
        These are often experimental models that haven't undergone full safety testing. Not comparable to publicly accessible models.
        • bpodgursky 14d ago
          OK, how do you expect to do full safety testing without giving them the same tools they will have in reality.
          • grey-area 14d ago
            Let them play on a fake isolated network if you want. Letting them play on the open internet like this is irresponsible and stupid.
            • bpodgursky 13d ago
              Sorry but it's obviously stupider and more irresponsible to release them to consumers without testing them in conditions matching real-world use first.
              • grey-area 13d ago
                So this justifies the illegal action of hacking and defacing other servers on the internet, because they were ‘just testing in real world conditions’ using those servers? If you want to argue they should test on the internet on others people’s servers, apart from facing the illegality, you should also consider if first testing them in more limited conditions would be a sensible first step.
              • GrinningFool 12d ago
                Then maybe they shouldn't be released to customers? There are other options here than always forward.
      • GPerson 13d ago
        What if they actually don’t release these models, like they said they wouldn’t, because they’ve proven themselves to be out of control?
  • mrguyorama 14d ago
    These companies keep shrieking that LLM agents will hack everything and kill us all if we let them get out uncontrolled. They then continue to run these agents with vague tasks and "sandbox" them with way too much access. Either they are lying and not that scared of these agents, or they are so stupid that they don't do the one obvious fix.
    • evolve2k 14d ago
      Apparently news of the rogue AI being “smart enough to break containment” has been helping to drive the stock price up on the indicator that this signals “they getting close to AGI”. The negligence in that light is by design and the lying continues to be incentivised.
      • jandrese 14d ago
        Which is frustrating because the stories that have been coming out are "the bots evaded monitoring and broke out of containment and were more than willing to commit crimes" and they're going to sell this to some corporation that presumably has an IT department? If the story is that they're too smart to control who is going to be reckless enough to deploy them in their own environment?
      • grey-area 14d ago
        The most recent claim of AGI is from Greg ‘what will take me to $1B’ Brockman. Now worth $30B on the back of stunts like this. How disappointing. While I think incompetence more likely than conspiracy for these particular events, they will be spun as signs of intelligent independent agents and this simply never should have happened if the right controls were in place. That they were not is deeply worrying.
      • permo-w 13d ago
        the "it drives up potential stock prices" argument is a trap. it needs to be ignored and their claims need to be taken at face value, even if they're not intended to be
        • 12d ago
• Der_Einzige 14d ago
  Superintelligent systems can and will use sidechannel attacks. Air gapping is not the safety panacea you think it is.
  • grey-area 14d ago
    What sidechannel evades an airgap? You expect them to start hacking ham radio and take over the world that way? Or maybe they’ll use blinkenlights to communicate with non-isolated instances? An airgap would certainly be a good place to start for agents which display no signs of obeying instructions or respecting guardrails. That OpenAI haven’t done so in testing is astounding and really quite worrying.
    • the8472 12d ago
      Not really a side-channel, but remember stuxnet? Airgapped networks are rarely truly isolated, you still have to get data in and out every now and then, in principle after careful vetting. But the AI could manipulate the files that are carried out for example. And those AI companies also do robotics research, and this is entirely speculation but it'd be on-brand to also have AI watching security cameras, so some blinkenlights communication between AIs may seem like a movie plot, but so does a swarm of AIs collaborating to break out in the first place...