Even if the Sohu Asic chip does attention part super fast, wont the bottlenecks come from, when this data goes to some next stage ? I'm just thinking whats the

Even if the Sohu Asic chip does attention part super fast, wont the bottlenecks come from, when this data goes to some next stage ? I'm just thinking whats the chance that we will actually start using ASIC chips for certain parts of AI inference.