6 ms·
There are people like that. We don't know what's up with them.
by ganzuul 2y ago
There are people like that. We don't know what's up with them.
- fragmede 2y agoIt's pretty easy to explain. You see, they're unable to produce a response that isn't in their training data. They're stochastic parrots.
- ImHereToVote 2y agoCan you?
- fragmede 2y agoSometimes, I get this absolute stroke of brilliance for this idea of a thing I want to make and it's gonna make me super rich, and then I go on Google, and find out that there's already been a Kickstarter for it and it's been successful, and it's now a product I can just buy. So apparently not.
- senordevnyc 2y agoI feel like everyone missed your joke :)
- fragmede 2y agoat least you did!
- sigh_again 2y agoNo, but then again you're not paying me $20 per month while I pretend I have absolute knowledge. You can, however, get the same human experience by contracting a consulting company that will bill you $20 000 per month and lie to you about having absolute knowledge.
- xpe 2y agoPlease clarify what you mean. On what basis do you say this? Unless I’m misunderstanding, I disagree. If you reply, I’ll bet I can convince you.
- sigh_again 2y agoUnless you have full access to the entirety of their training data, you can try to convince all you want, but you're just grasping at straws. LLMs are stochastic parrots incapable of thought or reasoning. Even their chains of thoughts are part of the training data.
- xpe 2y agoMost importantly, I'm happy to learn and/or be shown to be mistaken. Based on my study (not at the Ph.D. level but still quite intensive), I am confident the comment above is both wrong and poorly framed. Why? Seeing phrases "incapable of thought" and "stochastic parrots" are red flags to me. In my experience, people that study LLM systems are wary of using such brash phrases. They tend to move the conservation away from understanding towards combativeness and/or confusion. Being this direct might sound brusque and/or unpersuasive. My top concern at this point, not knowing you, is that you might not prioritize learning and careful discussion. If you want to continue discussing, here is what I suggest: First, are you familiar with the double-crux technique? If not, the CFAR page is a good start. Second, please share three papers (or high-quality writing from experts): one that supports your claim, one that opposes it, and one that attempts to synthesize. Third, perhaps we can find a better forum.
- 555watch 2y agoYour use of the word stochastic here negates what you are saying. Stochastic Generative models can generate new and correct data if the distribution is right. Its in the definition
- xpe 2y agoI'll try again... Can you (or anyone) define "thought" in way that is helpful? Some other intelligent social animals have slightly different brains, and it seems very likely they "think" as well. Do we want to define "thinking" in some relative manner? Say you pick a definition requiring an isomorphism to thoughts as generated by a human brain. Then, by definition, you can't have thoughts unless you prove the isomorphism. How are you going to do that? Inspection? In theory, some suitable emulation of a brain is needed. You might get close with whole-brain emulation. But how do you know when your emulation is good enough? What level of detail is sufficient? What kinds of definitions of "thought" remains? Perhaps something related to consciousness? Where is this kind of definition going to get us? Talking about consciousness is hard. Anil Seth (and others) talks about consciousness better than most, for what it is worth -- he does it by getting more detailed and specific. See also: integrated information theory. By writing at some length, I hope to show that using loose sketches of concepts using words such as "thoughts" or "thinking" doesn't advance a substantive conversation. More depth is needed. Meta: To advance the conversation, it takes time to elaborate and engage. It isn't easy. An easier way out is pressing the down triangle, but that is too often meager and fleeting protection for a brittle ego and/or a fixated level of understanding.
- SkyBelow 2y agoThey extract concepts from their training data and can combine concepts to produce output that isn't part of their training set, but they do require those concepts to be in their training data. So you can ask them to make a picture of your favorite character fighting mecha on an alien planet and it will produce a new image, as long as your favorite character is in their training set. But the extent it imagines an alien planet or what counts as mecha is limited by the input it is trained on, which is where a human artist can provide much more creativity. You can also expand it by adding in more concepts to better specify things. For example you can specify the mecha look like alphabet characters while the alien planet expresses the randomness of prime numbers and that might influence the AI to produce a more unique image as you are now getting into really weird combinations of concepts (and combinations that might actually make no sense if you think too much about them), but you also greatly increase the chance of getting trash output as the AI can no longer map the feature space back to an image that mirrors anything like what a human would interpret as having a similar feature space.
- xpe 2y agoThe paper that coined the term "stochastic parrots" would not agree with the claim that LLMs are "unable to produce a response that isn't in their training data". And the research has advanced a _long_ way since then. [1]: Bender, Emily M., et al. "On the dangers of stochastic parrots: Can language models be too big?." Proceedings of the 2021 ACM conference on fairness, accountability, and transparency. 2021.
- fragmede 2y agowoosh https://news.ycombinator.com/item?id=42343084 https://news.ycombinator.com/item?id=42343084