5 ms·
That's uhh...a language model?
by mattkrause 4mo ago
That's uhh...a language model?
- serf 4mo agoIt's a modeling of language, it's not structurally anything like an LLM.
- mattkrause 4mo agoIt’s literally a trigram (character) language model. Check any NLP book from before 2015 or so. LLMs have more stuff bolted onto them (embeddings, RLHF) but the autoregressive core is a direct descendent of that sort of language model.
- justinclift 4mo agoSo, LM vs LLM? :)
- trollbridge 3mo agoIt is structurally exactly the same thing as an LLM...