6 ms·
Thank you. Which is currently the most capable version running reasonably fast on a 3090 (24GB of VRAM)?
by brookman64k 2y ago
Thank you.
Which is currently the most capable version running reasonably fast on a 3090 (24GB of VRAM)?
- danielhanchen 2y agoThe Llama distilled version Q4_K_M should be reasonably fast and good!!