6 ms·
Is that prediction not based on matching previous patterns, whose frequencies are more or less encoded in the weights?
by beardedwizard 2mo ago
Is that prediction not based on matching previous patterns, whose frequencies are more or less encoded in the weights?
- snapcaster 2mo agoyou're really reaching for no apparent reason. Just move on from pattern matching machines it's not a good mental model for LLMs