6 ms·
https://duckdb.org/2024/05/03/vector-similarity-search-vss https://duckdb.org/2024/05/03/vector-similarity-search-vss
by tebeka 8mo ago
https://duckdb.org/2024/05/03/vector-similarity-search-vss https://duckdb.org/2024/05/03/vector-similarity-search-vss
- m00dy 8mo agodoes duckdb scale well over large datasets for vector search ?
- lgrebe 8mo agoWhat order of magnitude would you define as „large“ in this case?
- m00dy 8mo agolike over 1tb.
- cess11 8mo agoSome people are using DuckDB for large datasets, https://duckdb.org/docs/stable/guides/performance/working_with_huge_databases https://duckdb.org/docs/stable/guides/performance/working_wi... , but you'd probably do some testing under the specific conditions of your rig to figure out if it is a good match or not.
- riku_iki 8mo agoits clear many DuckDB sql queries can handle terabytes of data, but the question here was about vector search..
- jlarks32 8mo ago+1 on this one, I've been pleasantly surprised by this for a small (<3GB) local project