4 ms·I'm running 30b quant on my 3090. that many 4bits fortunately fit into my precious vramby yacine_ 3y agoI'm running 30b quant on my 3090. that many 4bits fortunately fit into my precious vram