4 ms·
For many LLM load, it seems ROCm is slower than vulkan. What’s the point?
by ycui1986 5mo ago
For many LLM load, it seems ROCm is slower than vulkan. What’s the point?
- mmis1000 5mo agoCompatibility so foundation packages like torch onnx-runtime can run on AMD GPU without massive change in architecture. It's the biggest reason for those stuff that "only works on nvidia gpu". It's not faster if vulkan alternative exists, but at least it runs.