6 ms·
This seems promising! Great work! Any chance there will be a Ollama Modelfile for the masses?
by schmeichel 2y ago
This seems promising! Great work! Any chance there will be a Ollama Modelfile for the masses?
- peakji 2y agoGGUF files are available on HF: https://huggingface.co/peakji/steiner-32b-preview-gguf https://huggingface.co/peakji/steiner-32b-preview-gguf I haven't personally used Ollama Modelfile, but I think it should be relatively easy to convert from GGUF?
- ca_tech 2y agoYou can now run any huggingface model using the following command ollama run hf.co/{username}/{repository} Example: ollama run hf.co/peakji/steiner-32b-preview-gguf:Q4_K_M Source: https://huggingface.co/docs/hub/en/ollama https://huggingface.co/docs/hub/en/ollama