5 ms·

Yeah, suggestive but hardly proof

• WarmWash 11d ago
  Many people still believe that LLMs can only reproduce what is in their training set.
  • stymaar 11d ago
    That'd be too restrictive, but to get improvement in a particular domain you definitely need to train specifically for it. Just cramming more random internet text in a bigger model has stopped being a effective way of scaling since at least mid 2023.
    • maleldil 10d ago
      No, you don't. There have been technological advances beyond just "more random Internet text", and they lead to more powerful models with more refined emergent behaviours.