18 ms·
(Team member of this project) Just a clarification, both Microsoft and Nvidia have ownership of this model. Here is the Microsoft version of same announcement.
by saurkt 5y ago
(Team member of this project)
Just a clarification, both Microsoft and Nvidia have ownership of this model. Here is the Microsoft version of same announcement.
https://www.microsoft.com/en-us/research/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model/ https://www.microsoft.com/en-us/research/blog/using-deepspee...