It was Nvidia’s competitors’ job to ensure this never happened but hardware companies rarely value the software stack as much as they should have. AMD screwed u

It was Nvidia’s competitors’ job to ensure this never happened but hardware companies rarely value the software stack as much as they should have. AMD screwed up several times to build a similar tool and Intel did not manage to create a proper programming model for their vector instruction sets despite having some promising internal efforts. Cuda allowed AlexNet to usher the deep learning era, written by university researchers. The flash attention implementation allowed quadratic attention to have reasonable memory requirements again written by a university professor and used by everyone. If I were to complain about Nvidia, I would complain about them abandoning the personal computing track for datacenter profits, definitely not about pushing Cuda.