17 ms·
"Hallucination" is just to term we use to say "this result is not what it should be". The model always uses the very same process, it does not do one thing for
by miraculixx 1y ago
"Hallucination" is just to term we use to say "this result is not what it should be". The model always uses the very same process, it does not do one thing for "hallucinations" and something else for "correct" results.
In a nutshell it is always predicting the next token from a joint probability distribution. That's it.
All other interpretations are speculative.