6 ms·
Yeah, I remember looking into it myself as well, and not finding any easy path. A shame.... Maybe there's a hard way to do it though :)
by juliusbk 2y ago
Yeah, I remember looking into it myself as well, and not finding any easy path. A shame.... Maybe there's a hard way to do it though :)
- rossant 2y agoI've been looking into this issue with Datoviz [1] following a user request. It turns out there may be a way to achieve it using Vulkan [2] (which Datoviz is based on) and CuPy's UnownedMemory [3]. I wrote a simple proof of concept using only Vulkan and CuPy. I'm now working on a way for users to wrap a Datoviz GPU buffer as a CuPy array that directly references the Datoviz-managed GPU memory. This should, in principle, enable efficient GPU-based array operations on GPU data without any transfers. [1] https://datoviz.org/ https://datoviz.org/ [2] https://registry.khronos.org/vulkan/specs/latest/man/html/VK_KHR_external_memory_fd.html https://registry.khronos.org/vulkan/specs/latest/man/html/VK... [3] https://docs.cupy.dev/en/latest/reference/generated/cupy.cuda.UnownedMemory.html#cupy.cuda.UnownedMemory https://docs.cupy.dev/en/latest/reference/generated/cupy.cud...
- kushalkolar 2y agoThis looks cools thanks! Makes me wonder if there's any way to do that with WGPU if WGPU is interfacing with Vulkan, probably not easy if possible I"m guessing. WGPU has security protections since it's designed for the browser so I'm guessing it's impossible.
- rossant 2y agoIndeed, it doesn't seem to be possible at the moment, see e.g. https://github.com/gfx-rs/wgpu/issues/4067 https://github.com/gfx-rs/wgpu/issues/4067
- paddy_m 2y agoWow. So are you saying that you can have some array on the GPU that you setup with python via CuPy, then you call to the webbrowser and give it the pointer address for that GPU array, and the browser through WASM/WebGPU can access that same array? That sounds like a huge browser security hole.
- kushalkolar 2y agoYea the security issue is why I'm pretty sure you can't do it on WGPU, but Vulkan and cupy can fully run locally so it doesn't have the same security concern.
- rossant 2y agoExactly, this is the sort of thing you can more easily do on desktop than in a web browser.
- rossant 2y agoI published my proof-of-concept here: https://gist.github.com/rossant/517806ea551f4038fd412c23c3d61a30 https://gist.github.com/rossant/517806ea551f4038fd412c23c3d6...