6 ms·
It's RAG never worked for me tbh. I thought it was simply because I didn't have Gpu.
by never_inline 1y ago
It's RAG never worked for me tbh. I thought it was simply because I didn't have Gpu.
- nirv 1y agoI tried it once, and I couldn't run RAG without the GPU either (only using external APIs). Considering that they pull all the heavy deps even with the local compute flags disabled, I assume this is just a poorly supported case. Which is really unfortunate.