7 ms·
Perhaps you are looking for larger savings but I would count the RWKV line of LLM architectures in this category: https://wiki.rwkv.com/basic/architecture.html
by te0006 11mo ago
Perhaps you are looking for larger savings but I would count the RWKV line of LLM architectures in this category:
https://wiki.rwkv.com/basic/architecture.html https://wiki.rwkv.com/basic/architecture.html
- SergiuNistor 11mo agoTotally, that counts. But indeed, I'm curious if anybody is trying even more radical ideas.