19 ms·
Well, pretty much all of the LLMs are based on the decode-only version of the Transformer architecture (in fact it’s the T in GPT). And in the Transformer arch
by Jorge1o1 8mo ago
Well, pretty much all of the LLMs are based on the decode-only version of the Transformer architecture (in fact it’s the T in GPT).
And in the Transformer architecture you’re working with embeddings, which are exactly what this article is about, the vector representation of words.