6 ms·

ROCm has improved a lot over the past few months, and now ROCm 5.6 seems to work out of box by just following this tutorial: https://rocm.docs.amd.com/en/latest

by junrushao1994 3y ago

ROCm has improved a lot over the past few months, and now ROCm 5.6 seems to work out of box by just following this tutorial: https://rocm.docs.amd.com/en/latest/deploy/linux/installer/install.html https://rocm.docs.amd.com/en/latest/deploy/linux/installer/i.... TVM Unity, the underlying compiler MLC LLM uses, seems to work out of box too on ROCm 5.6 - from Bohan Hou who sets up the environment

JonChesterfield 3y ago
Awesome. I'm going to paste that into the rocm dev channel. Actual positive feedback on HN, novel and delightful. Thank you for the blog post too!
kstenerud 3y ago
Are there any docker images containing this? I'd like to avoid getting into dependency hell with other software on my system, as happens all too often with new technologies.
- scrps 3y ago
  There are thankfully, quite a few, ive mostly used rocm/rocm-terminal and rocm/rocm-dev. https://hub.docker.com/u/rocm https://hub.docker.com/u/rocm
fweimer 3y ago
https://rocm.docs.amd.com/en/latest/release/gpu_os_support.html https://rocm.docs.amd.com/en/latest/release/gpu_os_support.h... and https://community.amd.com/t5/rocm/new-rocm-5-6-release-brings-enhancements-and-optimizations-for/ba-p/614745/jump-to/first-unread-message https://community.amd.com/t5/rocm/new-rocm-5-6-release-bring... suggest that Linux support is really limited at this point. Is this information inaccurate?
- JonChesterfield 3y ago
  Depends what support means to you really. The docs use support to mean things AMD tested and expect to work, modulo errata. If you're building the stack from source or found it in a Linux repo, decent odds it'll work for you. More likely to work on gfx9 or gfx10 than the older cards. I think that's roughly the last five years. If you use the official distribution, some parts are compiled to gpu-specific machine code and if your gpu isn't one of those, you can't use that library. I think there's a reluctance to compile the libs for GPUs that aren't in the internal CI in case they don't work. As an anecdote, I do most development on unsupported hardware, unsupported distro and unsupported kernel, with the upstream driver, using whatever was on llvm main that morning. That mostly works despite positioning myself as most likely to run into bugs.
- bavell 3y ago
  I'm still on rocm 5.4, been working great on my 6750XT for the past few months (Arch).

JonChesterfield 3y ago

Awesome. I'm going to paste that into the rocm dev channel. Actual positive feedback on HN, novel and delightful. Thank you for the blog post too!

kstenerud 3y ago

Are there any docker images containing this? I'd like to avoid getting into dependency hell with other software on my system, as happens all too often with new technologies.

scrps 3y ago
There are thankfully, quite a few, ive mostly used rocm/rocm-terminal and rocm/rocm-dev. https://hub.docker.com/u/rocm https://hub.docker.com/u/rocm

fweimer 3y ago

https://rocm.docs.amd.com/en/latest/release/gpu_os_support.html https://rocm.docs.amd.com/en/latest/release/gpu_os_support.h... and https://community.amd.com/t5/rocm/new-rocm-5-6-release-brings-enhancements-and-optimizations-for/ba-p/614745/jump-to/first-unread-message https://community.amd.com/t5/rocm/new-rocm-5-6-release-bring... suggest that Linux support is really limited at this point. Is this information inaccurate?

JonChesterfield 3y ago
Depends what support means to you really. The docs use support to mean things AMD tested and expect to work, modulo errata. If you're building the stack from source or found it in a Linux repo, decent odds it'll work for you. More likely to work on gfx9 or gfx10 than the older cards. I think that's roughly the last five years. If you use the official distribution, some parts are compiled to gpu-specific machine code and if your gpu isn't one of those, you can't use that library. I think there's a reluctance to compile the libs for GPUs that aren't in the internal CI in case they don't work. As an anecdote, I do most development on unsupported hardware, unsupported distro and unsupported kernel, with the upstream driver, using whatever was on llvm main that morning. That mostly works despite positioning myself as most likely to run into bugs.
bavell 3y ago
I'm still on rocm 5.4, been working great on my 6750XT for the past few months (Arch).