7 ms·
Nvidia is among the best positioned if open models win.
by pphysch 14d ago
Nvidia is among the best positioned if open models win.
- gscott 14d agoMost of nvidia's revenue comes from data center scale out. They will loose their ass if local models win.
- c0rruptbytes 13d agoopen models don’t imply local models… it just allows more people to run them, most likely with nvidia GPUs
- pixl97 13d agoAny model ran takes compute. Everybody, datacenters and local need compute. And I don't see a future where datacenters lose much to open models. I've ran local server rooms before clouds were a thing. Cooling and power is a very expensive pain in the ass. You're not dropping a rack of local models in most buildings without breaking the local power grid.
- malwrar 13d agoWhat about when the open models get to the point that you don’t need these fancy GPUs? It seems inevitable this will happen over time, we see cracks right now within even just GPT w/ expert streaming and flash attention. ASICs are coming soon too.
- jeanloolz 12d agoNvidia already have a plan in place for fast inference. They acquihire Groq last year
- ijidak 13d agoAWS and Azure would love to cut out OpenAI and Anthropic and sell inference on open models directly to businesses with no cut to share, just as AWS serves other open source software. Open models are great for everyone except anthropic and OpenAI.