8 ms·
What's the reason to not integrate with llama.cpp instead of a separate app? In what ways this better than llama.cpp?
by dankle 3y ago
What's the reason to not integrate with llama.cpp instead of a separate app? In what ways this better than llama.cpp?
- austinvhuang 3y agoOn uses, see https://news.ycombinator.com/item?id=39481554#39482302 https://news.ycombinator.com/item?id=39481554#39482302 and on llama.cpp support - https://news.ycombinator.com/item?id=39481554 https://news.ycombinator.com/item?id=39481554 Gemma support has been added to llama.cpp, and we're more than happy to see people use it there.
- freedomben 3y agoI think on uses you meant to link to https://news.ycombinator.com/item?id=39482581 https://news.ycombinator.com/item?id=39482581 child of https://news.ycombinator.com/item?id=39481554#39482302 https://news.ycombinator.com/item?id=39481554#39482302 ? side note: imagine how gnarly those urls would be if HN used UUIDs instead of integers for IDs :-D