6 ms·Finetuning 3-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers2 points by volodia 3y ago