6 ms·
I picked up the same model, including the shipping to Canada, it ended up costing a lot for what it is. How are you hosting your LLM locally? I tried Ollama o
by leftytak 6mo ago
I picked up the same model, including the shipping to Canada, it ended up costing a lot for what it is.
How are you hosting your LLM locally? I tried Ollama on an M4 Mac mini, even with a smaller LLM, the performance was very poor.