6 ms·
it does not require training a model from scratch for it to be updated. the entire LLM training process is iterative. essentially each step (there are hundreds/
by rbranson 2mo ago
it does not require training a model from scratch for it to be updated. the entire LLM training process is iterative. essentially each step (there are hundreds/thousands for a training run) yields a complete, usable model. tokens with updated data can be added on top essentially at any time in the future.
- dbalatero 2mo agoThat's good to know, but I think maybe the bulk of the original point is still concentrated in the "we always need new models to stay relevant" piece.