5 ms·
New embedding models support queries, so you don’t need to hallucinate a document before finding the nearest neighbor. Curious how it compares to this approach
by ed 1mo ago
New embedding models support queries, so you don’t need to hallucinate a document before finding the nearest neighbor. Curious how it compares to this approach since you’d get to skip the LLM altogether.
- bonoboTP 1mo agoWhat does it mean that an "embedding model supports queries"? An embedding model maps text to embedding vectors. You can always perform queries with such embedding vectors against a stored set of embeddings.
- ed 1mo agoRetrieval models are trained on query/document pairs. At inference you tell it which side the text is on via a prefix it learned during training. Which accomplishes the same thing as HyDE, but in the model instead of in text space. If the encoder has a query mode you skip the rewrite. Voyage has an example of this in `input_type` https://docs.voyageai.com/reference/embeddings-api https://docs.voyageai.com/reference/embeddings-api