6 ms·
Not strictly google but microsoft/bing too, here's the top ones from my notes: https://arxiv.org/abs/2410.14452 https://arxiv.org/abs/2410.14452 spfresh, https
by kingcauchy 6mo ago
Not strictly google but microsoft/bing too, here's the top ones from my notes:
https://arxiv.org/abs/2410.14452 https://arxiv.org/abs/2410.14452 spfresh,
https://arxiv.org/abs/2111.08566 https://arxiv.org/abs/2111.08566 spann,
https://arxiv.org/abs/2405.12497 https://arxiv.org/abs/2405.12497 rabitq,
https://arxiv.org/abs/2509.06046 https://arxiv.org/abs/2509.06046 diskann,
I have a variety of blogs that I used too and reference implementations!
It's a Rabit[Q]uantized Hierchical Balanced Clustering algorithm we use for the vector index and we use a chunked segment index for the sparse index if you're curious! Happy to discuss more!
- perfmode 6mo agoCurious if you’re using any SIMD optimizations for numerical calculations.
- kingcauchy 6mo agoYes we do use SIMD heavily! https://github.com/ajroetker/go-highway https://github.com/ajroetker/go-highway I also added SME support for Darwin for most algorithms. We use it in the full-text index, all over the vector indexes and heavily for the ml inference we do in go especially.