5 ms·
It's slower than the 4:1 ratio would imply, but it does indeed work. Things get really slow if the model doesn't for in vram + ram and you have to go from disk
by buckle8017 2mo ago
It's slower than the 4:1 ratio would imply, but it does indeed work.
Things get really slow if the model doesn't for in vram + ram and you have to go from disk to ram to vram.