5 ms·
Oh! Muna looks cool as well! I've just barely glanced at your docs page so far, but I'm definitely going to explore further. One of the biggest issues in the ba
by mhamann 1y ago
Oh! Muna looks cool as well! I've just barely glanced at your docs page so far, but I'm definitely going to explore further. One of the biggest issues in the back of our minds is getting models running on a variety of hardware and platforms. Right now, we're just using Ollama with support for Lemonade coming soon. But both of these will likely require some manual setup before deploying LlamaFarm.
- olokobayusuf 1y agoWe should collab! We prefer to be the underlying infrastructure behind the scenes, and have a pretty holistic approach towards hardware coverage and performance optimization. Read more: - https://blog.codingconfessions.com/p/compiling-python-to-run-anywhere https://blog.codingconfessions.com/p/compiling-python-to-run... - https://docs.muna.ai/predictors/ai#inference-backends https://docs.muna.ai/predictors/ai#inference-backends
- rgthelen 1y agoThis looks awesome. Are you kind of like lemonade? Let's chat - robert@llamafarm.dev