aislamov

8 ms·

1. 1.▲
   Latent consistency model working directly in the browser on WebGPU(islamov.ai)

   3 points by aislamov 3y ago|1 comments
2. 2.▲
   by aislamov 3y ago

   Model allows image generation in 4-8 steps. 8 steps on M1 Max take 8 seconds, on RTX 3090Ti just 3 seconds. Requires latest chrome canary. Model paper here https://latent-consistency-models.github.io
3. 3.▲
   by aislamov 3y ago

   > Hold on, to run your demo does one have to click the "Load Model" button before doing anything? Yes. I thought it won't be good if it would download 3.5gb once you open the page. >Now I'm wondering whether the to
4. 4.▲
   by aislamov 3y ago

   What error message do you get?
5. 5.▲
   by aislamov 3y ago

   UNET takes about a 1:10 on WebGPU and around a minute on CPU in one thread. VAE is 2 minutes on CPU and about 10 seconds on GPU. It should be because most GPU ops for VAE are already implemented but for UNET are not. So in the latter case b
6. 6.▲
   by aislamov 3y ago

   That's really impressive and much more performant. I was following a different approach: to run any ONNX model without prior modifications.
7. 7.▲
   Stable Diffusion WebGPU demo(islamov.ai)

   473 points by aislamov 3y ago|116 comments
8. 8.▲
   by aislamov 3y ago

   No additional libraries required on Windows (even CUDA). For linux you'll need to install CUDA and onnxruntime gpu lib.