6 ms·
… or the safety argument is an attempt at regulatory capture and an effort to outlaw open models. The absolute nightmare scenario for these people isn’t termin
by api 1mo ago
… or the safety argument is an attempt at regulatory capture and an effort to outlaw open models.
The absolute nightmare scenario for these people isn’t terminators. They’re fine with that, and in some cases are already doing it or supporting politicians who are doing it. Autonomous “kill chains” are a thing. It’s just happening overseas… so far. The politicians doing these things were backed by the heads of these companies. They don’t care about AI killing people.
No, the nightmare scenario for these guys is there is no moat. Their whole empires, which are built on training models on open source and sometimes pirated data, are easily duplicated. Worse, recent progress on models at the 30B size suggests that large gains in efficiency or compression are on the table. That means someone might release a cheap to run frontier grade model… or someone might crack distributed continuous training.
In other words… there is no moat.
So they need to scare some politicians into heavily regulating the space before that happens.
- bottlepalm 1mo agoYou care about open models and you project that care on to the world and your rationalization of it. In reality open models are a thing, but not the biggest issue. Open/closed whatever the advance of capabilities is the real issue people are concerned about.
- api 1mo agoI’m not afraid of AI, even AI with extreme abilities. I am afraid of humans with AI. That’s because I’m afraid of humans. When I look around the world I see humans murdering and robbing each other. When I get online on almost any social media I’m confronted by a wall of hate and grievance. I am afraid of what humans will do with AI, and one of my biggest concerns there is what happens if small groups of powerful humans are able to monopolize it and leverage it against the rest of humanity. The rest of humanity can’t defend itself by leveraging it back because they don’t have it. It was kept from them for “safety.” If the AI itself starts showing emergent volition and acting independently, I find that less scary. Not zero scary but more a mix of concern and fascination. The human monopolizing AI scenario makes me wish I had a weapons stockpile, as if it would matter. I’ll explain it like this. Two options. Option 1 is you wake up to find a grey alien or a ghost in your room, something alien and beyond your understanding. Option 2 is you wake up and find some random guy in your room. Which do you pick? I pick option 1. I’d be afraid if I saw something paranormal, but in a less visceral way. I see a dude I’m going to start scanning the room for anything I could use as a weapon.
- bottlepalm 29d agoI agree with the first part of your post, I'm worried about humans using AI, maliciously which I'm sure they will, but also with good intentions that back fires on them like the hugging face incident. To me the ASI we're heading towards is like a super intelligent toddler that will use it's immense power to knock over its blocks accidentally (the blocks being the human race). The second part of your post, I'll take the random guy in my room over the alien. I'll be scared of the guy for sure, but I think I would freak the f out with an alien.