7 ms·

What would you propose instead?

• jmull 3y ago
  Just "abilities present in large models not present in small models". This also makes clear its relative nature (that is, what "large" and "small" mean), which the use of the word "emergent" obscures.
  • 1123581321 3y ago
    That’s much longer and raises more questions (what is large and small, does this gradually or discretely appear.)
  • LawTalkingGuy 3y ago
    There's things which small models can't do, and where obviously a large model works better. Not emergence, I agree. I think they're using emergent for a different category of things - still things that a small model couldn't do, but specifically which a large model can just do without any of the work we thought we'd have to do for that ability. Or at least, that's how I see emergent being a useful term, both in a behavior and a value context.