5 ms·
Interesting. But the gguf file for llama2 is 4.78 GB in size. For ollama, llama2:7b is 3.8 GB. See: https://ollama.ai/library/llama2/tags https://ollama.ai/lib
by anhldbk 3y ago
Interesting. But the gguf file for llama2 is 4.78 GB in size.
For ollama, llama2:7b is 3.8 GB. See: https://ollama.ai/library/llama2/tags https://ollama.ai/library/llama2/tags. Still I see ollama requires less RAM to run llama 2