4 ms·
Can the 30 second embedding time be done beforehand and sent to the browser? Inference is nice and quick after that.
by aetherspawn 2mo ago
Can the 30 second embedding time be done beforehand and sent to the browser?
Inference is nice and quick after that.
- soycaporal 2mo agoyes, you could run a 1 time indexing run on the server side, and just ship the embeddings to frontend