5 ms·
related and possibly more general purpose https://github.com/t8/hypura https://github.com/t8/hypura
by khimaros 2mo ago
related and possibly more general purpose https://github.com/t8/hypura https://github.com/t8/hypura
- Archit3ch 2mo agoWith so many people implementing their own SSD streaming for specific combinations of model+hardware, maybe we should look into upstreaming to antirez/ds4 or llama.cpp...