6 ms·

> Nvidia has been (somewhat paradoxically) a dominant force in actual "open source" AI Nothing paradoxical about it, open source AI use raises demand for nvidi

> Nvidia has been (somewhat paradoxically) a dominant force in actual "open source" AI Nothing paradoxical about it, open source AI use raises demand for nvidia's chips too.

davrosthedalek 20d ago
And I would say it's actually a more secure future demand channel than the hyperscalers. Openai and co can build their own chips, so they won't buy from NVidia. But they probably won't sell them to somebody else, so everyone who wants to run their own install (and can, not the least because of HF), will buy Nvidia.
dpoloncsak 20d ago
Locking the next generation of programmers into CUDA
- John7878781 20d ago
  Translating CUDA kernels to ROCm (or any other ecosystem, tbh) is going to become trivially easy with AI. Not saying that code is the only glue that Nvidia has when it comes to their ecosystem, but it’s certainly a large part of it.
  - tovej 20d ago
    It's not that difficult at the moment. Don't know why you would need an LLM to translate between two nearly identical language extensions. Optimization is different, but that's not really a translation level task.
    - spunker540 19d ago
      If an LLM can do a rote task for me, I don’t see why I wouldn’t use it
      - tovej 19d ago
        Because it's more expensive and more likely to fuck it up.
- musebox35 20d ago
  It was Nvidia’s competitors’ job to ensure this never happened but hardware companies rarely value the software stack as much as they should have. AMD screwed up several times to build a similar tool and Intel did not manage to create a proper programming model for their vector instruction sets despite having some promising internal efforts. Cuda allowed AlexNet to usher the deep learning era, written by university researchers. The flash attention implementation allowed quadratic attention to have reasonable memory requirements again written by a university professor and used by everyone. If I were to complain about Nvidia, I would complain about them abandoning the personal computing track for datacenter profits, definitely not about pushing Cuda.

> Nvidia has been (somewhat paradoxically) a dominant force in actual "open source" AI Nothing paradoxical about it, open source AI use raises demand for nvidia's chips too.

davrosthedalek 20d ago

And I would say it's actually a more secure future demand channel than the hyperscalers. Openai and co can build their own chips, so they won't buy from NVidia. But they probably won't sell them to somebody else, so everyone who wants to run their own install (and can, not the least because of HF), will buy Nvidia.

dpoloncsak 20d ago

Locking the next generation of programmers into CUDA

John7878781 20d ago
Translating CUDA kernels to ROCm (or any other ecosystem, tbh) is going to become trivially easy with AI. Not saying that code is the only glue that Nvidia has when it comes to their ecosystem, but it’s certainly a large part of it.
- tovej 20d ago
  It's not that difficult at the moment. Don't know why you would need an LLM to translate between two nearly identical language extensions. Optimization is different, but that's not really a translation level task.
  - spunker540 19d ago
    If an LLM can do a rote task for me, I don’t see why I wouldn’t use it
    - tovej 19d ago
      Because it's more expensive and more likely to fuck it up.
musebox35 20d ago
It was Nvidia’s competitors’ job to ensure this never happened but hardware companies rarely value the software stack as much as they should have. AMD screwed up several times to build a similar tool and Intel did not manage to create a proper programming model for their vector instruction sets despite having some promising internal efforts. Cuda allowed AlexNet to usher the deep learning era, written by university researchers. The flash attention implementation allowed quadratic attention to have reasonable memory requirements again written by a university professor and used by everyone. If I were to complain about Nvidia, I would complain about them abandoning the personal computing track for datacenter profits, definitely not about pushing Cuda.