6 ms·
Because safety and welfare have literally nothing to do with LLMs. They generate text. If someone is stupid enough to hook the text generator up to nuclear miss
by 10000truths 9d ago
Because safety and welfare have literally nothing to do with LLMs. They generate text. If someone is stupid enough to hook the text generator up to nuclear missile launchers and try to "align" it against nuclear annihilation with a "pretty please don't do that" prompt, I'm not going to blame the AI for the impending nuclear apocalypse, I'm going to blame the idiot who handed the big red button to the digital equivalent of a toddler.
- zith 9d agoWell, giving it access to a simple linux terminal is theoretically enough to cause more damage than most people are comfortable with, and doing so is trivial enough that it will be done (and has been, tens of thousands of times).
- flexagoon 9d agoShould we also morally align the Linux terminal then?
- lemonfever 9d agoWhat if LLMs completely unrelated to the nuclear missile ecosystem autonomously hack their way in (maybe with sophisticated social engineering)?
- mrtesthah 9d agoReplace LLMs with APTs in that sentence,
- Certhas 9d agoHumans are biological machines that generate further humans. Lawyers and diplomats and politicians and bureaucrats are humans, that only generate text. We are seeing LLMs have cognitive abilities that significantly exceed human abilities. At the same time, they are clearly not the same type of mind that humans are. They are something new. I think the widespread "they are just text generators" and "they are just tools" are comforting lies rather than an honest look at what we are seeing right now. Intellectually lazy. And by the way, there has been a long-standing consensus among ethicists, philosophers, and sociologists that technology is not value-neutral [1]. Of course Silicon Valley has a long-standing tradition of denying this. [1] For example Footnote 1 in https://www.jstor.org/stable/27106634 https://www.jstor.org/stable/27106634 or https://plato.stanford.edu/entries/technology/#EthiTech https://plato.stanford.edu/entries/technology/#EthiTech
- graemep 9d ago> Lawyers and diplomats and politicians and bureaucrats are humans, that only generate text. You think they have no lives outside their work? You think even their work has no interactions that are not written?
- titularcomment 9d agoWhat is this 'mind' you speak of? As everyone else is intellectually lazy, how do you define the transformer architecture under the hood of LLMs?
- nozzlegear 8d ago> Lawyers and diplomats and politicians and bureaucrats are humans, that only generate text. This is a bad take. > We are seeing LLMs have cognitive abilities that significantly exceed human abilities. At the same time, they are clearly not the same type of mind that humans are. They are something new. They're software, not minds. What's intellectually lazy is pretending they're anything else.
- arc619 9d agoLLMs don't produce text at all, they produce probabilities of tokens. Tokens aren't text, they're high dimenensional coordinates in a latent "concept space". These are displayed to us as text, but this distinction is important when you think about what they're actually doing, which is closer to building and transforming concept geometries.
- tryphan 9d agoGood thing no one involved in the chain of events for that to occur is an idiot...
- anthonyrstevens 8d ago>> They generate text Can we retire this incorrect meme please
- nozzlegear 8d agoYeah, they also generate images!
- chpatrick 8d agoSo if a model with exactly the same architecture controls a robot then it's suddenly sentient or what? "They generate actions in the real world"