6 ms·
wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies
by senectus1 6d ago
wouldnt you be better off maxing out the new Mac hardware? the memory bandwidth is insane on those jobbies
- bigyabai 6d agoIf your goal is pure GPU compute, you should have got a 5090. It can bench comparable to the RTX 6000 Pro cards and is near guaranteed to outperform M5 Ultra.
- wmf 6d agoTwo RTX 6000 have more FLOPS and more memory bandwidth than a M5 Ultra (but they also cost more).
- rubyn00bie 6d agoThere’s roughly 50% more memory bandwidth on an RTX 6000 pro versus the M5 Ultra. I imagine it really comes down to what you’re doing, I know my 5090 runs laps around the M5 Pro I have when it comes to local LLM performance (until it runs out of memory). If it wasn’t for the fact the 6000 Pro is selling for like 100% ($9,000) over MSRP it would probably look a lot more reasonable.
- fsuts 6d agoDepends on your use case If running models then Apple is fine, if training or tuning or large number of users then Nvidia is king