5 ms·

Takeoff Inference Server Is Now Open Source

• mezark 3y ago
  Drop in replacement for HF's TGI server. The fastest and easiest way to inference LLMs locally Github: https://github.com/titanml/takeoff https://github.com/titanml/takeoff Docs: https://docs.titanml.co/docs/titan-takeoff/getting-started https://docs.titanml.co/docs/titan-takeoff/getting-started Discord: https://discord.gg/83RmHTjZgf https://discord.gg/83RmHTjZgf