6 ms·
> how to navigate the world without fully understanding or having a complete model of it GPT-4 does not have ANY understanding or model of the world - it just
by drpixie 3y ago
> how to navigate the world without fully understanding or having a complete model of it
GPT-4 does not have ANY understanding or model of the world - it just has a model of what tokens (words) are likely to appear in a certain context. If it could build any usable model of the world, and reason about it, I'd be much more impressed.
When it quacks like a duck, only the most simplistic view takes it as being a duck.
- TFYS 3y agoIsn't our understanding or model of the world just what images, sounds, smells, tastes and physical feelings are likely to appear in a certain context? Obviously a language model doesn't yet have access to all the data humans have, but that doesn't mean there can't be some kind of a model of the world. If you invent a new word and give a couple example sentences, GPT-4 can figure out the meaning without ever seeing the word. Doesn't that require some kind of understanding?
- deleted 3y ago[deleted]