5 ms·
"It thought about its money. It reflected on its own purpose. It questioned what it even means to be an autonomous agent." I don't think it did any of that.
by enopod_ 5mo ago
"It thought about its money. It reflected on its own purpose. It questioned what it even means to be an autonomous agent."
I don't think it did any of that.
- lamasery 5mo agoAll these years later and the Eliza effect is as powerful as ever.
- spwa4 5mo agoYou could reverse that argument. The only thing that ever happens in a human mind is a Sodium-Kalium semi-permeable membrane balancing out (meaning going from polarized to unpolarized) and triggering the tiniest of explosions spreading one of 4 chemicals around. Repeat a few billion times per second for ~80 years. The Eliza effect is off the scale. What I'm trying to say is that the underlying method is not a valid reason to discredit one thinking process over another.
- deleted 5mo ago[deleted]
- lamasery 5mo agoI remain baffled that anyone thinks dragging brains into discussions of these things does anything but make everyone more confused. This kind of thing is exactly what I'm getting at—that it's common for even people in the computer technology field to think the comparison is apt, or illuminates anything, is a wild indication of how inclined we are to be tricked by computer programs that happen to operate on language.
- spwa4 5mo agoThe point is, of course, that human thinking is also a physical process, build on basic building blocks.
- Kim_Bruning 5mo agoFeeling is mutual, actually O:-) Anthropomorphism and Anthropodenial are both variants of Anthropocentrism, and share the same limitations. Have you considered other axes of thought? I can readily admit that lots of humans will naively anthropomorphize horrendously, but I think that: - The eliza effect is not what people think it is - What is actually going on is obscured by all the anthropomorphizing - But this is yet no grounds to throw out the underlying phenomenon, especially when a) it can be useful and/or b) it causes people to get hurt.
- stevenhuang 5mo agoYou are baffled because of your own ignorance of the underlying principles under discussion. Do you believe in a dualist interpretation of reality, that the process of thinking is somehow nonphysical? That these programs operate on language is besides the point. The fact you think this is why it's interesting shows you don't even understand the argument. Are you familiar with the physical church turing thesis?
- Kim_Bruning 5mo agoThe effect is not quite what you think it is, and people don't quite take the right lessons. Similar to the eliza effect, people still take the original reading of Clever Hans: "he couldn't really do maths, he's just taking social cues from his handler" But what's the actual difference between Eliza, Clever Hans and RLHF? They're doing the similar things, right? Now look at how we valued that in the 20th vs 21st century: How much does an ALU even cost anymore? even a really good one? (it's almost never separate anymore, usually on the same silicon as the rest of the cpu/microcontroller) Meanwhile... what's the TCO to deploy a sentiment classifier? Especially a really good one?
- onemoresoop 5mo agoWe also believe in supranatural things so it’s no wonder we assign sentience so easily.
- SAI_Peregrinus 5mo agoI fell for it a few minutes the other day. Debugging an issue with a device, the AI wrote "I have a strong hypothesis about the cause in the code". I asked it to write out the hypothesis & create a test plan to validate it. It made a test plan, but no hypothesis. The test plan did not reproduce the issue, and it turned out to be a hardware design problem not in the code at all. But for a moment in there I thought it actually had a hypothesis, I forgot that it's not thinking beyond what's written in the chat. Someone who was going to reproduce & fix a bug would probably write "I have a strong hypothesis about the cause" or similar, so it played along & wrote that.
- Kim_Bruning 5mo agoIf the hypothesis is not printed out in the context, then it cannot hold it past that turn. You could prompt it to generate said hypothesis first (or set of hypotheses), and only then act on them. And then things might work. Definitely not exactly a human. OTOH Low hanging fruit is low.
- micromacrofoot 5mo agoI'm not disagreeing, but what is thought? If I write something down, read it, and write more words about those words... did I think about it? How would you prove that I did or did not?
- William_BB 5mo agoIf you randomly sample letters from the alphabet and those letters make up actual words, then actual sentences. Did you think about it? Probably not
- OKRainbowKid 5mo agoIt's not sampling randomly though.
- miltonlost 5mo ago"it" is also not "thinking". It is still randomly (though not all words are equal probabilities) sampling from a distribution of words that have been stolen and it been trained on
- Kim_Bruning 5mo agoIf "randomly sampling from a trained distribution" can't produce useful, meaningful output, then deterministic computation is even more suspect. After all, it's a strict subset. You're sampling with temperature zero from a handcrafted distribution. (this post directionality ok, but there's many a devil in the details)
- falcor84 5mo ago> you randomly sample letters from the alphabet and those letters make up actual words, then actual sentences That sounds like a decently apt description of how I (a human) communicate. The only thing is that I suppose you implied a uniform distribution, while my sampling approach is significantly more complicated and path-dependent. But yes, to the extent that I have some introspective visibility into my cognitive processes, it does seem like I'm asking myself "which of the possible next letters/words I could choose would be appropriate grammatically, fit with my previous words, and help advance my goals" and then I sample from these with some non-zero temperature, to avoid being too boring/predictable.
- flatline 5mo agoIt certainly thought it did all that -- this was (presumably) not written by a human.
- deleted 5mo ago[deleted]
- 6stringmerc 5mo agoCounterpoint: When is the last time you, as a human being, honestly did that? This isn’t trying to be glib or contentious, it’s a commentary on the nature of human existence. If you have, then your answer will show it. If you have not, your silence or excuses will also.
- alpha_squared 5mo agoAll the time? This morning when I dreaded getting up so early for work. Last night when I showered. The day before after playing some board games with friends. Normal people do introspect, despite the current fad among a few oddball elites in Silicon Valley [0]. [0] https://www.theverge.com/tldr/897566/marc-andreessen-is-a-philosophical-zombie https://www.theverge.com/tldr/897566/marc-andreessen-is-a-ph...
- weird-eye-issue 5mo agoA lot
- enopod_ 5mo agoI do this way too often :)
- dlev_pika 5mo agoWaaay too much
- pwillia7 5mo agoI mean we don't know right? Feels hubrisy
- naravara 5mo agoThis article reads like it’s been proofread or written out from an outline or bullet points given to an AI. And ALMA’s own posts that it references are just meandering ramblings, they’re really a slog to get through. I think I’ve always tended to immediately notice the signs of sloppy thinking in the writing style and it’s been such a reliable heuristic that AI writing kind of short circuits me. I tend to get down a couple of paragraphs before I pause and realize “Wait a minute, this isn’t SAYING anything!” Even when there is an underlying point the writing often feels like a very competent college student trying to streeeeeetch to hit a word count without wanting to actually flesh their idea out past the topic statement.