4 ms·
Is it possible to try this out on something like llama.cpp? Does the different architecture make a difference there?
by nickthesick 3y ago
Is it possible to try this out on something like llama.cpp? Does the different architecture make a difference there?
- deleted 3y ago[deleted]
- kristjansson 3y agoThere's https://github.com/saharNooby/rwkv.cpp https://github.com/saharNooby/rwkv.cpp, which related-ish[0] to ggml/llama.cpp [0]: https://github.com/ggerganov/llama.cpp/issues/846 https://github.com/ggerganov/llama.cpp/issues/846