5 ms·
Nice! Do they have plans to bring even bigger models down to ~16GB VRAM so that more consumer hardware might be useful?
by Luker88 2mo ago
Nice!
Do they have plans to bring even bigger models down to ~16GB VRAM so that more consumer hardware might be useful?
- verdverm 2mo agobigger quant'd harder is not always better than a model of more modest size and quant