6 ms·
What do people learn from visualizations like this? What is the most important problem anyone has solved this way? Speaking as somewhat of a co-defendant.
by graphviz 1y ago
What do people learn from visualizations like this?
What is the most important problem anyone has solved this way?
Speaking as somewhat of a co-defendant.
- jablongo 1y agoI lets you inspect what actually constitutes a given cluster, for example it seems like the outer clusters are variations of individual words and their direct translations, rather than synonyms (the ones I saw at least).
- minimaxir 1y agoNot everything has to be directly informative or solve a problem. Sometimes data visualization can look pretty for pretty's sake. Dimensionality reduction/clustering like this may be less useful for identifying trends in token embeddings, but for other types of embeddings it's extremely useful.
- diwank 1y agoAgreed. The fact that it has any structure at all is fascinating (and super pretty). Could signal at interesting internal structures. I would love to see a version for Qwen-3 and Mistral too! I wonder if being trained on significant amounts of synthetic data gave it any unique characteristics.
- TuringNYC 1y ago> What do people learn from visualizations like this? Applying the embeddings model to some dataset of yours of interest, and then a similar visualization, is where it gets cool because you can visually look at clusters and draw conclusions about the closeness of items in your own dataset
- ethan_smith 1y agoEmbedding visualizations have helped identify bias in word embeddings (Word2Vec), debug entity resolution systems, and optimize document retrieval by revealing semantic clusters that inform better indexing strategies.
- graphviz 1y agoInteresting, glad to know it's been useful for some specific contributions. (Not questioning that interesting-looking, appealing displays as overviews for general awareness are also worthwhile.)