6 ms·
I think they run whatever models they get paid to run. But mostly from enterprise. They are clearly not interested in consumer dollars.
by eli 29d ago
I think they run whatever models they get paid to run. But mostly from enterprise. They are clearly not interested in consumer dollars.
- gpm 29d agoI mean the product is a server rack and while there's no advertised price I would assume it's six figures. So yes, an enterprise product. But even an enterprise is going to care about the difference between "we can run the model we want with support from the manufacturer" and "we have to purchase the product, and then spend another 6 figure sum having developers port a recent model to the product to use it".
- WarmWash 29d agoI feel like 6-figures would be the clearance price on it...
- oceanplexian 29d ago6 figures is a single mid range Xeon or Epyc server these days.
- kube-system 29d agoYou’re at least an order or magnitude under… likely two. A single AI server with a mere 8 GPUs from Nvidia is already mid 6 digits. A rack system from Nvidia is mid 7 digits. There’s some info out there that suggests the CS1 had an 8 digits price tag, so it wouldn’t be surprising to see that here.
- gpm 29d agoYeah, did some googling after WarmWash's comment and I concur.