There is also the 1bit version @ 3.9 GB that retains 90% of the intelligence - quite a feat! https://huggingface.co/prism-ml/Bonsai-27B-mlx-1bit https://huggin

There is also the 1bit version @ 3.9 GB that retains 90% of the intelligence - quite a feat! https://huggingface.co/prism-ml/Bonsai-27B-mlx-1bit https://huggingface.co/prism-ml/Bonsai-27B-mlx-1bit