7 ms·
They used to publish some benchmarks on their site, but seem to have removed them. You can find them on archive.org[1]. I guess it is understandable, since vect
by pbadams 4y ago
They used to publish some benchmarks on their site, but seem to have removed them. You can find them on archive.org[1]. I guess it is understandable, since vector search performance is pretty unpredictable, and depends on a lot of factors. If their target market is people who want vector search without needing to read a bunch of papers first, benchmarks might be more confusing than they are helpful.
edit: While I do think it's understandable, it's not great for transparency. Even if they don't want to open-source their index, I would admire it if they were willing to give ann-benchmarks[2] an API key to publish some independent results.
Disclaimer: I work on vector search at a different company
[1] https://web.archive.org/web/20210227105542/https://www.pinecone.io/learn/similarity-search-benchmarks/ https://web.archive.org/web/20210227105542/https://www.pinec...
[2] https://github.com/erikbern/ann-benchmarks https://github.com/erikbern/ann-benchmarks