5 ms·
Unfortunately, Vulkan Compute doesn’t to all the things that OpenCL, SYCL, HIP or CUDA do.
by swerner 2mo ago
Unfortunately, Vulkan Compute doesn’t to all the things that OpenCL, SYCL, HIP or CUDA do.
- binsquare 2mo agoYep, there are inference stacks where it just does not work without cuda in any meaningful performance
- DiabloD3 2mo agoWeird, since the most used open source inference engine is faster on Vulkan on platforms that offer multiple options, with the sole exception being Nvidia, due to poor Nvidia driver quality (which I am forced to assume is intentional, Nvidia wishes to maintain their moat after all).
- inigyou 2mo agoThere's nothing stopping any of us from writing a better Nvidia driver btw. LLMs are very helpful with reverse engineering.
- HelloNurse 2mo agoBeing fast and being as easy to program as CUDA are two different things.