7 ms·
If you run say ollama in docker vs native you lose MPS (metal core like the way CUDA works but Mac) which is really a deal breaker to do any AI work via docker
by jamescampbell 8mo ago
If you run say ollama in docker vs native you lose MPS (metal core like the way CUDA works but Mac) which is really a deal breaker to do any AI work via docker for doing things with local models, which is my use case to have a full fast VM inside my mac.