5 ms·
it does feel like so, the position eventually loses its meaning as more and more data gets crunched by the training process, eventually it's just a context of t
by nivekkevin 3y ago
it does feel like so, the position eventually loses its meaning as more and more data gets crunched by the training process, eventually it's just a context of the past 4 tokens it feels like