6 ms·
Certainly an important discovery for utilizing these models on scaled hardware. This approach could certainly be applied beyond LLMs to other types of neural ne
by bdbenton5255 1y ago
Certainly an important discovery for utilizing these models on scaled hardware. This approach could certainly be applied beyond LLMs to other types of neural networks. That would be an interesting space to explore.
- zhihaojia 1y agoThanks for the feedback! Yes, we believe the approach is general and applicable to other ML workloads.