5 ms·
Interesting how long it takes to get this “assistant” functionality on a local running models with llama for e.g.? It’s seems like many use cases require access
by tiomat 2y ago
Interesting how long it takes to get this “assistant” functionality on a local running models with llama for e.g.? It’s seems like many use cases require access to user data.
- timm37 2y agolocal running would be impossible as you would need your computer running 24/7 (since the widget is available on your website which is always online). But building a simple RAG/Vector DB on top of llama3 is not very complicated.