7 ms·
Also interesting: https://github.com/apple/ml-sharp https://github.com/apple/ml-sharp Apples model to generate Gaussian splats from a single image. Takes about
by sovok 4mo ago
Also interesting: https://github.com/apple/ml-sharp https://github.com/apple/ml-sharp
Apples model to generate Gaussian splats from a single image. Takes about 30 seconds on an M1 Pro.
It falls apart once you move too much, but for a little side-wiggling or a second-eye view for VR, it's great. And looks a lot better than the old approach of depth map + vertex shaders that I use in https://github.com/combatwombat/tiefling https://github.com/combatwombat/tiefling. But ml-sharp has 2.6 GB weights, a bit too big to run in the browser.
- RobotToaster 4mo agoAny idea what kind of vram is needed to run this on Nvidia?
- sovok 4mo agoThe Python process peaks at about 15 GB, so maybe a 24 GB GPU works. But others seem to have problems wih Nvidia: https://github.com/apple/ml-sharp/issues/84 https://github.com/apple/ml-sharp/issues/84
- kridsdale1 4mo agoIt runs natively on the Photos app in Vision Pro, which shares 16GB of ram with GPU and CPU.
- mnorris 4mo agoThe smallest Nvidia gpu I've run Sharp on is an Nvidia T4 which I think has 16 GB on the chip
- ben7799 4mo agoIs this thing the basis of what Apple is doing in the Photos app in the most recent OS revisions? It seems to work a lot quicker than 30s now on iDevices and Macs.