8 ms·
Yes they do…? Who cares if they just predict the next token? The outcome is that they can invent new abstractions. You could claim that the invention of this ne
by peterlk 4mo ago
Yes they do…? Who cares if they just predict the next token? The outcome is that they can invent new abstractions. You could claim that the invention of this new idea is a combination of an LLM and a harness, but that combination can solve logic puzzles and invent abstractions. If a really large spinning wheel could invent proofs that were previously unsolved, that would be a wildly amazing spinning wheel. I view LLMs similarly. It is just fancy autocomplete, but look what we can do with it!
Said differently, what is prediction but composition projected forward through time/ideas?
- voooduuuuu 4mo agoAsk an LLM to invent a new word and post it here, I will be waiting. You will see that it simply combines words already in the training data.
- bossyTeacher 4mo agoDoes a random sequence of letters qualify as a new word?
- motoxpro 4mo ago[flagged]
- planetafro 4mo agoSplifket Definition: That highly specific, short-lived burst of nervous energy that makes you accidentally drop a small object (like a pen, a guitar pick, or a piece of LEGO) immediately after picking it up.
- jimmaswell 4mo agoWhy is everyone who responds to this with a real example immediately flagged/dead?
- sillysaurusx 4mo agoHN autokills LLM generated comments. People don’t seem to believe this, but there’s proof for you.
- deleted 4mo ago[deleted]
- romanhn 4mo agoI'm not sure what the point of this exercise is. My prompt to ChatGPT: "Create a new English word with a reasonably sounding definition. That word must not come up in a Google search." Two attempts did come up in a search, the third was "Thaleniq (noun)". Definition: The brief feeling that a conversation has permanently changed your opinion of someone, even if nothing dramatic was said. Nothing in Google. There, a new word, not sure it proves or disproves anything. Or is it time to move the goal posts?
- peterlk 4mo ago[dead]
- FrustratedMonky 4mo ago"Who cares if they just predict the next token?" Exactly. I also only write one word at a time. Who knows what is going on in order to come up with that word.