5 ms·
GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-gguf https://huggingface.co/peakji/steiner-32b-preview-gguf I haven't persona
by peakji 2y ago
GGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-gguf https://huggingface.co/peakji/steiner-32b-preview-gguf
I haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF?
- ca_tech 2y agoYou can now run any huggingface model using the following command ollama run hf.co/{username}/{repository} Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_M Source: https://huggingface.co/docs/hub/en/ollama https://huggingface.co/docs/hub/en/ollama