7 ms·
An open course on building high performance LLM inference engine! Hope to finish by the end of April https://github.com/jmaczan/tiny-vllm https://github.com/jm
by yu3zhou4 5mo ago
An open course on building high performance LLM inference engine! Hope to finish by the end of April
https://github.com/jmaczan/tiny-vllm https://github.com/jmaczan/tiny-vllm