4 ms·
> not prediction based on anything statistical but based on one's understanding It is still statistical. You still want to predict a distribution over expecte
by mooneater 4y ago
> not prediction based on anything statistical but based on one's understanding
It is still statistical. You still want to predict a distribution over expected next token.
However, the function needed to estimate the likely next tokens are not simple max over enumerated next tokens like in a language model. It's more like a transition model in reinforcement learning.
- NateEag 4y ago> It is still statistical. You still want to predict a distribution over expected next token. The fact that a process can be described statistically does not make the process itself statistical.
- DeathArrow 4y agoWith the current craze of neural networks people would like to think that anything that happens in the Universe is statistical. But it's really not.
- passion__desire 4y agoQuantum mechanics is probablistic. But the probabilities are deterministic.