6 ms·
I wonder what the target audience for this price range is? At that price point I would rather go for a single H100.
by menaerus 6d ago
I wonder what the target audience for this price range is? At that price point I would rather go for a single H100.
- lukeschlather 6d agoI would rather take this option than a single H100: > 96 GB Dual NVIDIA RTX PRO 5000 w/ 1000W PSU (non-refundable) +$19,169 Though I don't think there's anything stopping you from trying to stuff an H100 into this machine if you want to BYO.
- menaerus 6d agoFor that price you get the H100. The machine is overpriced, and I'd personally rather go for a second-hand workstation with server-grade components.
- embedding-shape 6d agoHopper is ~4 years old at this point though, compared to Blackwell which is ~2 years old, the difference isn't nil. Depending on your use case, you might prefer native FP4 and FP6 low-precision support and 5th-generation Tensor Cores rather than what Hopper offers. I think for training Hopper makes sense as it's generally a bit cheaper and the difference isn't that big, but for inference the difference widens a bunch makes a lot more sense to go with Blackwell.
- menaerus 5d agoYou're correct, the difference isn't nil - H100 is data-center grade GPU with loads of bandwidth and compute while RTX PRO is a consumer grade GPU. The difference between the microarchitectures would make sense to point out if we had been comparing apples to apples and not apples to pits.
- lukeschlather 5d agoI would assume an H100 selling for less than $30k is a scam. I see one for 11,329€, and one for $25k but most are over $30k and I don't know how to judge these random storefronts. You've bought an H100 for $20k that was in working order recently?
- menaerus 5d agoWhat kind of comment is that? No, I have not bought the h100 obviously, and, yes, you can buy the new one for 20k. Used one for even less.