5 ms·
Depends on what yield AMD has, they may be able to undercut that if aiming for marketshare rather than revenue. The marginal cost of each chip is dollars. The
by electronbeam 2y ago
Depends on what yield AMD has, they may be able to undercut that if aiming for marketshare rather than revenue.
The marginal cost of each chip is dollars. The 5 digit prices for H100s are just margins to be undercut
- gdiamos 2y agoAfter deep diving into building datacenters, I realized that traditional clouds (AWS, Google, azure) add a huge margin to GPUs like H100s. You can (and I think should), cut it out by going with coreweave, lambda, another or doing it yourself I’m okay paying that huge margin to first tier cloud for CPUs and disks, which are cheap, but not GPUs