8 ms·

Thanks Daniel. Do you recommend any resources showing the differences between different quantizations?

• danielhanchen 1y ago
  Oh our blog https://docs.unsloth.ai/basics/unsloth-dynamic-2.0-ggufs https://docs.unsloth.ai/basics/unsloth-dynamic-2.0-ggufs compares the accuracy differences for each different quantization method for Llama 4 Scout and also Gemma 3 27B - they should apply to other quants (like Qwen 3 Coder)