5 ms·
Running DeepSeek R1 on Your Own (cheap) Hardware – The fast and easy way
- BimJeam 2y agoSet up a local AI with DeepSeek R1 on a dedicated Linux machine using Ollama—no cloud, no subscriptions, just raw AI power at your fingertips.
- croes 2y agoOllama doesn’t run Deepseek, just distilled versions
- diffeomorphism 2y agoThat seems false? https://ollama.com/library/deepseek-r1 https://ollama.com/library/deepseek-r1 This includes the full model and additionally several distills.
- croes 2y agoYou are right, it lists Deepseek V2
- BimJeam 2y agoSorry if you guys get so overwhelmed with deepseek submissions these days. This will be my one and only in the next time. It is cool to have an anti-weight to all these pay models.
- ai-christianson 2y agoPersonally I don't get sick of it. There's a lot of hype around Deepseek specifically rn, but to run SOTA or near SOTA models locally is a huge deal, even if it's slow.
- danielbln 2y agoThe issue is that this article is conflating (as do many, many articles about the topic) the distilled versions of R1 (basically llama/qwen reasoning finetunes) with the real thing. We are not even talking about quantized versions of R1 here, so it's not quite accurate to say you're running R1 here.
- BimJeam 2y agoHey the model from https://ollama.com/library/deepseek-r1 https://ollama.com/library/deepseek-r1 is used. This is not the real thing? Just 671b is the real thing or what are you going to tell me?
- nickthegreek 2y agoJust 671b is the real thing.
- assimpleaspossi 2y agoAre there any security concerns over DeepSeek as there are over TikTok? Saw this in the article >I would not recommend running this on your main system. Unless you like unnecessary risks.
- croes 2y agoThe model itself can’t do anything bad despite giving false answers or block them. Using hosted versions where host collects data or using a unknown software that runs the model is the risk.
- donclark 2y agoI like this. However, I did not find any minimum specs or speed. Maybe I missed? Can some point me in the right direction please?
- throwaway638637 2y agoThis is what you would expect given the title
- cwizou 2y agoMaybe you should add "distills" to the title? As this is about installing Ollama to grab the 7b or 14b R1-Qwen-distills, not "R1".
- nkozyra 2y agoRight, and fundamentally no different than running any other ollama model that can run reasonably on your local machine.
- karmakaze 2y ago"The fast and easy way" is also being oversold. > Why Ollama? Because it makes running large language models actually easy. > If it doesn’t work, fix your system. That’s not my problem.
- BimJeam 2y agoOK I understand now and will fix that title. Sorry for that inconvenience. My bad. :-/
- ghostie_plz 2y ago> Unless you like unnecessary risks. In that case, go ahead, genius. what an off-putting start
- Euphorbium 2y agoI have R1:1.5B running on my 8gb ram M4 mac mini. Dont know where I would use it, as it is too weak to solve actual problems, but it does run.