While those are good reasons to keep the weights static from a business perspective, they are not the only reasons, especially when serving SOTA models at the s

While those are good reasons to keep the weights static from a business perspective, they are not the only reasons, especially when serving SOTA models at the scale of some of the major shops today. Continual/online learning is still an area of active research.