6 ms·
If there was no moat, nvidia and meta would have SoTA models too.
by VirusNewbie 13d ago
If there was no moat, nvidia and meta would have SoTA models too.
- seunosewa 13d agoMeta is awfully close.
- dansquizsoft 13d agolol! Good one...
- nwienert 13d agoWent from years behind to months pretty quick.
- amazingamazing 13d agoIt is not in nvidia’s interest to be too good at model creation
- david-gpu 13d agoWhy not? Commoditize your complement, and all that.
- angulardragon03 13d agoAnd if they get too good, they risk harming or otherwise killing their golden geese (their customers), who they are heavily invested in.
- david-gpu 13d agoHow? Imagine an open-weight model comes out that is somehow better than proprietary solutions. Now the marginal cost for the consumer is just the cost of renting the inference hardware, without having to pay the overhead of the owner of a proprietary model. And because it is cheaper, more customers want to use it, and Nvidia will sell the providers the inference hardware that they need.
- amazingamazing 13d ago1. No open ai and anthropic means no buying gpus to train. Now nvidia spends money on hardware training their own models. Opportunity cost plus expense. 2. Any open models created from this will not necessarily need their silicon, see apple mlx.
- haldujai 13d ago1. I don’t think that’s a very strong argument. OpenAI and Anthropic don’t buy the vast majority of GPUs they use they rent capacity. Nvidia could just the same rent those GPUs out for inference and actually have way better margins than they do right now. Antitrust and putting all your eggs in one basket are why they don’t, similar to TSMC. 2. Neither do AI labs. See Anthropic buying TPUs, deploying with AMD. OpenAI on Maia, Cerebras, their own wafers.
- angulardragon03 11d agoIt’s not about whether or not Nvidia will be able to sell hardware to these providers - it’s about literally killing companies they are financially invested in. Why would you invest money in a company, and then enter the market to compete with them?
- reilly3000 13d agoBut it is in their interest that their customers can use their models as a base for post-training and LoRAs.
- amazingamazing 13d agoThey don’t necessarily need their own models for that
- cmrdporcupine 13d agoThey have models for that. That's what the Nemotron series is. Not just open weights but open training data too and full tutorials on how to use them to fine tune or train your own models. They exist to keep people using and advancing the tools on their hardware.
- sensanaty 13d ago[dead]
- evilduck 13d agoNvidia does have one of the best completely open models. Open weights are nice but Nemotron is open training data too.