5 ms·
Finally, a reasonable output dim size. 1536 was just nuts, and added 4x the cost of HNSW in RAM compared to something like the e5 small models at 384 dims.
by binarymax 3y ago
Finally, a reasonable output dim size. 1536 was just nuts, and added 4x the cost of HNSW in RAM compared to something like the e5 small models at 384 dims.
- teaearlgraycold 3y agoYou can always do PCA on your end
- binarymax 3y agoPCA doesn’t work at all for embeddings. Maybe in some rare cases, but it’s throwing away knowledge and the loss in accuracy is usually quite drastic.
- teaearlgraycold 3y agoReally? I'm no specialist in the area I just use embeddings for search at work. The ML guy at work tells me our dinov2 embeddings should PCA quite nicely once we need that.