5 ms·
> LLMs do just interpolate their training data "interpolate" has a technical meaning - in this meaning, LLMs almost never interpolate. It also has a very vague
by jmmcd 4mo ago
> LLMs do just interpolate their training data
"interpolate" has a technical meaning - in this meaning, LLMs almost never interpolate. It also has a very vague everyday meaning - in this meaning, LLMs do interpolate, but so do humans.
- astrange 4mo agoAn LLM in a harness with any tools (even a calculator) doesn't just interpolate because it can reach states out of its own distribution.