5 ms·
An LLM generates plausible text token by token. It is at its core a deterministic function with some randomization and some clever tricks to make it look like a
by kbrkbr 5mo ago
An LLM generates plausible text token by token. It is at its core a deterministic function with some randomization and some clever tricks to make it look like an agent dialoguing or reasoning.
Plausible text sometimes is right, sometimes not.
Humans have a world model, a model of what happens. LLMs have a model of what humans would plausibly say.
The only good guardrail seems human-in-the-loop.
- armada651 5mo agoThis is such a motte-and-bailey argument. Whenever people point out LLMs aren't actually intelligent then you're an anti-AI Luddite. But whenever an AI does something catastrophically dumb it's absolved of all responsibility because "it's just predicting the next token". I'm getting so tired of this.
- kbrkbr 5mo agoI think they are not actually intelligent. Fix all random seeds and other sources of randomness, and try the same prompt twice, and check how intelligent that looks, as a first approximation. On a more technical level very serious people have voiced doubts, for example Richard Sutton in an interview with Dwarkash Patel [1]. [1] https://m.youtube.com/watch?v=21EYKqUsPfg&pp=ygUnZmF0aGVyIG9mIHJsIHRoaW5rcyBsbG1zIGFyZSBhIGRlYWQgZW5k0gcJCd4KAYcqIYzv https://m.youtube.com/watch?v=21EYKqUsPfg&pp=ygUnZmF0aGVyIG9...