4 ms·
PCA doesn’t work at all for embeddings. Maybe in some rare cases, but it’s throwing away knowledge and the loss in accuracy is usually quite drastic.
by binarymax 3y ago
PCA doesn’t work at all for embeddings. Maybe in some rare cases, but it’s throwing away knowledge and the loss in accuracy is usually quite drastic.
- teaearlgraycold 3y agoReally? I'm no specialist in the area I just use embeddings for search at work. The ML guy at work tells me our dinov2 embeddings should PCA quite nicely once we need that.