11 ms·
LLMs can't access the training data that's less than the statistically most common token, so they use a random jitter. With that randomness comes statistically
by nosuchthing 7mo ago
LLMs can't access the training data that's less than the statistically most common token, so they use a random jitter.
With that randomness comes statistically irrelevant results.