7 ms·
Mark Russinovich shares some of it in this recent Ignite session: https://ignite.microsoft.com/en-US/sessions/49347847-9ae4-430b-952f-44df08595c4a?source=/speak
by willyyr 3y ago
Mark Russinovich shares some of it in this recent Ignite session: https://ignite.microsoft.com/en-US/sessions/49347847-9ae4-430b-952f-44df08595c4a?source=/speakers/19ea1daf-562e-4510-9426-cf5943f8ae54 https://ignite.microsoft.com/en-US/sessions/49347847-9ae4-43... *I work at Microsoft but have nothing to do with the datacenter engineering or other insights into the details behind it.
- zurfer 3y agoSo 14400 H100 for GPT-4, but that's just a fraction of the new system that Azure is building for OpenAI. FWIW, I most enjoyed the 29TB machine demo at the end.