7 ms·
Nice demo but its lacks one feature to make it practical: splitting the input documents in chunks. Without it the embeddings will be too broad, and when retrie
by madarco 2y ago
Nice demo but its lacks one feature to make it practical: splitting the input documents in chunks.
Without it the embeddings will be too broad, and when retrieved the docs will consume a lot of input tokens, making the request slower/expensive