5 ms·
sorry - what do you mean by embeddings in your last sentence?
by spruce_tips 7mo ago
sorry - what do you mean by embeddings in your last sentence?
- rco8786 7mo agoNot OP. But embeddings are the internal matrix representations of tokens that LLMs use to do their work. If tokens are the native language that humans use, embeddings are the native language that LLMs use. OP, I think, is saying that once LLMs start communicating natively without tokens is when they shed the need for humans or human-level communication. Not sure I 100% agree, because embeddings from one LLM are not (currently) understood by another LLM and tokens provide a convenient translation layer. But I think there's some grain of truth to what they're saying.
- spruce_tips 7mo agoYea I knew embeddings I just didn’t quite understand it in OPs context. Makes sense, thanks