6 ms·
Drop in replacement for HF's TGI server. The fastest and easiest way to inference LLMs locally Github: https://github.com/titanml/takeoff https://github.com/ti
by mezark 3y ago
Drop in replacement for HF's TGI server. The fastest and easiest way to inference LLMs locally
Github: https://github.com/titanml/takeoff https://github.com/titanml/takeoff
Docs: https://docs.titanml.co/docs/titan-takeoff/getting-started https://docs.titanml.co/docs/titan-takeoff/getting-started
Discord: https://discord.gg/83RmHTjZgf https://discord.gg/83RmHTjZgf