You can point at the GGUF files and figure it out with your hardware here. https://github.com/gdevenyi/huggingface-estimate https://github.com/gdevenyi/hugging

You can point at the GGUF files and figure it out with your hardware here. https://github.com/gdevenyi/huggingface-estimate https://github.com/gdevenyi/huggingface-estimate