8 ms·
AMD leaps after launching AI chip that could challenge Nvidia dominance
- w-m 3y agoFrom yesterday: AMD MI300 performance – Faster than H100, but how much? https://news.ycombinator.com/item?id=38550271 https://news.ycombinator.com/item?id=38550271
- deleted 3y ago[deleted]
- DeathArrow 3y agoDo they have a good CUDA alternative?
- no_wizard 3y agoCan't speak to how it compares to CUDA however they are developing ROCm[0] [0]: https://www.amd.com/en/products/software/rocm.html https://www.amd.com/en/products/software/rocm.html
- echelon 3y agoNext to nothing is written that targets this. Not Stable Diffusion, not RVC, not Vall-E, not Tacotron, not Tortoise, ... Maybe the LLM space is better about this, but the generative media side definitely isn't. AMD has a market share of 0% here, and nobody publishes models with AMD support.
- coffeebeqn 3y agoCould there be a compiler/transpiler from CUSA to whatever AMD is pushing ?
- puzzlingcaptcha 3y agoThat's what https://github.com/ROCm/HIPIFY https://github.com/ROCm/HIPIFY is (as a part of ROCm)
- zamalek 3y agoI think it's llama.cpp that simply #defines all cuda_ functions to rocm_ (99% name-name). Porting seems to be that trivial.
- Symmetry 3y agoThe things is you can actually run Stable Diffusion. And I got PyTorch working on my AMD 7900 XT graphics card recently, though it was a bit of a hassle to do so.
- godshatter 3y agoYou can also run Stable Diffusion in cpu mode, if you don't mind it being slower. I have an NVIDIA card but it's not powerful enough to run it. I'm on Ubuntu.
- echelon 3y ago> though it was a bit of a hassle to do so. Incredible understatement. And the diverse set of community tools also breaks down. We're still a year or more out from proper AMD support in the ecosystem.
- zamalek 3y agoI can attest that it works really well on my 6900xt. Compiling CUDA kernels is merely a matter of a using a #define shim. Also, provided you download the ROCm pytorch (and force compatibility with the HSA_OVERRIDE_GFX_VERSION) everything just works.
- dekken_ 3y agoit's called hip, and it's mostly the same AMD have their own thrust gpu impls, so from a high level they are somewhat interchangeable
- 2OEH8eoCRo0 3y agoI don't know, but couldn't people use LLMs to drastically lower the cost of switching? Converting a codebase to use a different platform doesn't require creativity.
- gumballindie 3y agoI think we shouldnt even try, because LLMs will simply design new hardware and software all by its own. All we need to do is sit and watch, while collecting UBI.
- machinekob 3y agoNo
- gafage 3y agoAccording to the news and tech blogs AMD is always ahead of nvidia in all regards. But then, you have real life...
- eganist 3y ago> According to the news and tech blogs AMD is always ahead of nvidia in all regards. But then, you have real life... Do you have examples of both sides of this claim?
- gafage 3y agoOne side of this claim: https://www.msn.com/en-us/lifestyle/shopping/amd-leaps-after-launching-ai-chip-that-could-challenge-nvidia-dominance/ar-AA1l8RWS https://www.msn.com/en-us/lifestyle/shopping/amd-leaps-after... The other side of this claim: sales numbers of GPUs.
- eganist 3y ago> One side of this claim: https://www.msn.com/en-us/lifestyle/shopping/amd-leaps-after https://www.msn.com/en-us/lifestyle/shopping/amd-leaps-after... The stated claim was "According to the news and tech blogs AMD is always ahead of nvidia in all regards." Which necessitates sources that aren't the parent article being discussed. Because "always" and "in all regards" were invoked, not just AI > The other side of this claim: sales numbers of GPUs. Your claim "But then, you have real life..." implies that the news sites you didn't cite are wrong in claiming AMD technical supremacy, not that sales numbers are off. To restate the question: do you have news references stating that AMD is always and in all regards ahead of nvidia? And then do you have real life data points to prove that said news sites are wrong?
- xnx 3y ago> Advanced Micro Devices shares were marked 2% higher in premarket trading 2% is a "leap"? It looks like NVDA is up ~1.5% since yesterday.
- jraby3 3y agoThey are up 6% today which is significant.
- FredPret 3y agoAMD needs to launch drivers, not chips. Who’s going to develop ML models on a card that can’t connect to a popular ML model? I look at their financial performance and it’s staggering how they’ve missed the boat - and this is during a huge boom on gaming, crypto, and AI. Compare: https://valustox.com/AMD https://valustox.com/AMD VS https://valustox.com/NVDA https://valustox.com/NVDA
- machinekob 3y agoThey are not only missed AI boom, they are also seems to be overpriced by a huge margin compared to Intel or even NVDA.
- visarga 3y agoThat's not such a big concern, LLMs run on all things today. It won't be that hard to make them work on AMD. Before 2020 we had much more architectural diversity.
- FredPret 3y agoThe last time I tried getting Tensorflow / Pytorch to work on my good (and cheap) AMD card, I literally ended up just buying an Nvidia card. I’m just one guy but my experience carries over to subsequent business decisions made by me, and there are many like me.
- Workaccount2 3y agoI'll throw my hat in the ring, I didn't buy an nvidia card, I simply gave up on trying to get it working.
- FredPret 3y agoNvidia drivers on Linux aren’t a walk in the park either, but at least there’s a way to do it.
- dharma1 3y ago
- machinekob 3y agoThis time AMD will win for sure (Copium)
- mupuff1234 3y agoAMD market cap is bigger than Intel.
- cloudengineer94 3y agoThey gotta keep working on the software side of things like drivers, FSR and more. AMD is so far behind on this. In the other hand though, their 3D Cache chips are amazing
- bryanlarsen 3y agoOn Linux, AMD drivers are far ahead of Nvidia. Switching from a 970 to a 3750 fixed a bunch of visual glitches for me.
- TheBigSalad 3y agoIt barely moved. This stock goes up and down 5% all the time. It was at the current price a week ago.
- ChrisArchitect 3y agoSome more discussion yesterday: https://news.ycombinator.com/item?id=38548330 https://news.ycombinator.com/item?id=38548330
- brucethemoose2 3y agoWait... this headline totally wrong. This is the actual source[1]: > The AMD Instinct M1300A APU was launched in January 2023 and blends a total of 13 chiplets, of which many are 3D stacked, creating a single chip package with 24 Zen 4 CPU cores fused with a CDNA 3 graphics engine and eight stacks of HBM3 memory totaling 128GB. Its literally a typo (or renamed SKU?) for the MI300A. So... the street is jumping on AMD because of a typo echoed by a ton of outlets? https://www.datacenterdynamics.com/en/news/genci-upgrades-adastra-supercomputer-with-amd-apus/ https://www.datacenterdynamics.com/en/news/genci-upgrades-ad...
- CuriousCosmic 3y agoIt is a typo but in a different way. They are referring to the MI300X (mentioned again later). The discussion on the MI300X was on HN like 12 hours ago (after the AMD announcement event yesterday): https://news.ycombinator.com/item?id=38550271 https://news.ycombinator.com/item?id=38550271 https://www.youtube.com/watch?v=tfSZqjxsr0M https://www.youtube.com/watch?v=tfSZqjxsr0M
- brucethemoose2 3y agoThat's technically not new either? Are they just talking about MI300X availability?
- CuriousCosmic 3y agoIt very much is though. the MI300X may have been known about prior to the event but specs and performance were all under embargo until December 6.
- nightski 3y agoAMD gatekeeps this functionality behind it's non-consumer cards. They don't realize that having a consumer card and being able to develop on it is a gateway to using AMD. I can use CUDA on any Nvidia card I buy. I can't believe they are so incredibly dense on this.
- LeanderK 3y agolol, this is so stupid. Don't they realise that people usually develop locally and train on a server? You don't need a super beefy GPUs to do it, so you buy nvidia. So people are used to nvidia, debug and fix bugs etc. It's not a very smart decision, looks like the decision makers have no idea what's going on.
- paulmd 3y agoAMD’s opencl runtime also historically has an incredible number of bugs and paper features that make any sort of portability between nvidia and AMD cards quite difficult - you are running a special build and a different codepath for AMD anyway, there was no gain from using the ostensibly portable approach.
- latchkey 3y agoThe gain is that you can't find time on NVIDIA cards right now. Decentralizing away from a single provider lowers the risk on your business significantly. Case in point, OpenAI closed new signups because they couldn't keep up with demand and they literally have all the resources in the world to make things happen.
- 65a 3y agoYou can run inference and training on consumer AMD cards today. It works fine, including llama.cpp, stable diffusion, hugging face transformers, etc. Way cheaper for a given performance/VRAM target as well.
- thrtythreeforty 3y ago
- riffic 3y agomsn.com, really?
- ek750 3y agowhat would you prefer? Would WSJ or other paywalled sites make you happy? Don't make me start submitting aol links.