6 ms·
Yeah for comparison, `tinygrad` takes a little over a second per iteration on my machine. https://github.com/tinygrad/tinygrad/blob/master/examples/stable_diffu
by WinLychee 3y ago
Yeah for comparison, `tinygrad` takes a little over a second per iteration on my machine.
https://github.com/tinygrad/tinygrad/blob/master/examples/stable_diffusion.py https://github.com/tinygrad/tinygrad/blob/master/examples/st...
- brucethemoose2 3y agoIs that on GPU or CPU? 1 it/s would be very respectable on CPU. The fastest implementation on my 2060 laptop is AITemplate, being about 2x faster than pure optimized HF diffusers.
- WinLychee 3y agoThat was on GPU, and there are various CPU implementations (e.g. based on Tencent/ncnn) on github that have similar runtime (1-3s / iteration).