5 ms·
tbh im not sure what amds plan is on ROCm support on consumer devices, but i dont really think amd is being fraudulent or something. Both rocm and vulkan are s
by junrushao1994 3y ago
tbh im not sure what amds plan is on ROCm support on consumer devices, but i dont really think amd is being fraudulent or something.
Both rocm and vulkan are supported in MLC LLM as mentioned in our blog post. we are aware that rocm is not sufficient to cover consumer hardwares, and in this case vulkan is a nice backup!
- zorgmonkey 3y agoHow does the performance with Vulkan compare to the ROCm performance on the same hardware?
- junrushao1994 3y agoWe haven't done any comparison them yet, but generally we believe Vulkan as a more generic cross-vendor API should be slower than ROCm. Same for CUDA vs Vulkan.
- ttctciyf 3y agoIf you click the "Radeon" tab here[1], dated 27 Jul, AMD claim ROCm support on a wide range of consumer cards, with HIP SDK support on RX 6800 and up, under Windows. The Linux situation seems less clear. 1: https://rocm.docs.amd.com/en/latest/release/windows_support.html#windows-supported-gpus https://rocm.docs.amd.com/en/latest/release/windows_support....
- imtringued 3y agoGiven AMDs track record. The 6900 will be dropped next year or early 2025.