6 ms·
https://www.producttalk.org/context-rot https://www.producttalk.org/context-rot this article summarises several papers that have explored this, and it does seem
by aevv 1mo ago
https://www.producttalk.org/context-rot https://www.producttalk.org/context-rot this article summarises several papers that have explored this, and it does seem to be related to both the absolute number of tokens and the % of the window