6 ms·
Humanity isn't stateless.
by shanebellone 3y ago
Humanity isn't stateless.
- chpatrick 3y agoNeither is text generation as you continue generating text.
- shanebellone 3y ago"Neither is text generation as you continue generating text." LLM is stateless.
- chpatrick 3y agoOn a very fundamental level the LLM is a function from context to the next token but when you generate text there is a state as the context gets updated with what has been generated so far.
- shanebellone 3y ago"On a very fundamental level the LLM is a function from context to the next token but when you generate text there is a state as the context gets updated with what has been generated so far." Its output is predicated upon its training data, not user defined prompts.
- chpatrick 3y agoIf you have some data and continuously update it with a function, we usually call that data state. That's what happens when you keep adding tokens to the output. The "story so far" is the state of an LLM-based AI.
- shanebellone 3y ago'If you have some data and continuously update it with a function, we usually call that data state. That's what happens when you keep adding tokens to the output. The "story so far" is the state of an LLM-based AI.' You're conflating UX and LLM.
- chpatrick 3y agoI never said LLMs are stateful.
- shanebellone 3y ago[flagged]
- dang 3y agoPlease don't do flamewar on HN. It's not what this site is for, and destroys what it is for. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- shanebellone 3y agoReally? Delete my account.
- danenania 3y agoYou're being pedantic. While the core token generation function is stateless, that function is not, by a long shot, the only component of an LLM AI. Every LLM system being widely used today is stateful. And it's not only 'UX'. State is fundamental to how these models produce coherent output.
- shanebellone 3y ago"State is fundamental to how these models produce coherent output." Incorrect.
- alpaca128 3y ago> Its output is predicated upon its training data, not user defined prompts. Prompts very obviously have influence on the output.
- shanebellone 3y ago"Prompts very obviously have influence on the output." The LLM is also discrete.
- jazzyjackson 3y agothe model is not effected by its inputs over time its essentially a function that is called recursively on its result, no need to represent state
- chpatrick 3y agoBeing called recursively on a result is state.
- jazzyjackson 3y agoif you say so, but the model itself is not updated by user input, it is the same function every time, hence, stateless.