15 ms·
Indeed! I'm just looking at JVector which I wasn't familiar with - looks cool. Have you tried it with the billion-scale competition? (not sure if that's still
by binarymax 1y ago
Indeed! I'm just looking at JVector which I wasn't familiar with - looks cool. Have you tried it with the billion-scale competition? (not sure if that's still running)
- jbellis 1y agosort of, there was the original bigann and then they followed up with a couple more specialized contests the following year, i think it's over now ~300M modern-sized vectors is pretty close to jvector's limit in a single index (the Cassandra layer can shard more) https://foojay.io/today/indexing-all-of-wikipedia-on-a-laptop/ https://foojay.io/today/indexing-all-of-wikipedia-on-a-lapto... that said I think Mariano (new jvector maintainer) is working on ways to handle larger datasets in a single index but I'm not sure where that is on his priority list