gravadlax

5 ms·

1. 1.▲
   by gravadlax 7y ago

   Hi, I am one of the authors of the post. We tried using LOPQ, but I don't know the exact parameters used. We probably did not put enough effort into it, though. Your approach seems interesting. Maybe we will try something similar in th
2. 2.▲
   by gravadlax 7y ago

   We do have our own custom word (piece) embeddings that we have trained on <good query, bad query>-pairs. There are a few more details about it in https://0x65.dev/blog/2019-12-06/building-a-search-engine-fr..
3. 3.▲
   by gravadlax 7y ago

   Just a couple of things: - We are actually using a weighted average. - This is just one of the techniques used for recall. The aim at this point is to be super fast and scalable, and not super accurate. Once we reach the precision stage of
4. 4.▲
   by gravadlax 7y ago

   Hi, I am one of the authors of this post. As you mention, it is a trade-off. In this case we are trying to balance CPU and memory usage. First of all, if you just use the original vectors (or the quantized ones mentioned in the post), it mi
5. 5.▲
   by gravadlax 7y ago

   Hi, I am one of the authors of this post. The number 4 billion is made-up. It was chosen in order to illustrate the scale of the problem we are trying to solve. And it also happens to be just below the maximum number possible to store in an