This won't happen so long as the bandwidth bottleneck is a thing. Local models are just several orders less efficient at scale, and this limitation is inherent

This won't happen so long as the bandwidth bottleneck is a thing. Local models are just several orders less efficient at scale, and this limitation is inherent to the architecture and won't go away unless both hardware and model structure change enormously. There are really only two usecases I can see for local models going forward: - 10-1000 person groups such as corporations where you can amortize serious hardware with parallel use - Porn.