6 ms·
Indeed: https://arxiv.org/pdf/2402.01032.pdf https://arxiv.org/pdf/2402.01032.pdf Perhaps future iterations of SSMs will accommodate dynamically sized (but stil
by hansonw 3y ago
Indeed: https://arxiv.org/pdf/2402.01032.pdf https://arxiv.org/pdf/2402.01032.pdf
Perhaps future iterations of SSMs will accommodate dynamically sized (but still non-linearly-growing) hidden states / memories!