6 ms·
I posted this elsewhere, but Unsloth says the 27B model should run in 18GB. That leaves little RAM for other tasks, but it depends on your tolerance for slownes
by MatthiasPortzel 3mo ago
I posted this elsewhere, but Unsloth says the 27B model should run in 18GB. That leaves little RAM for other tasks, but it depends on your tolerance for slowness I suppose. I haven’t tried it in 24GB so report back if you do.
https://unsloth.ai/docs/models/qwen3.6 https://unsloth.ai/docs/models/qwen3.6