6 ms·
> Why did I initially spend the extra $1600 if I knew ahead of time that it wasn't as good as cloud AI? Because I thought I could use some local LLM for the eas
by pizza234 16d ago
> Why did I initially spend the extra $1600 if I knew ahead of time that it wasn't as good as cloud AI? Because I thought I could use some local LLM for the easy tasks or when I hit cloud rate limits.
The maths don't check. With Deepseek Flash one goes a very long way with 1600$ - even 10$/month, for easy jobs, are more than 13 years, and at a higher quality.
- deleted 16d ago[deleted]
- wolvoleo 16d agoOh no doubt. But one does have the guarantee that no bits left their home and that's a big one for some. The low hanging fruit stuff for me is more something I use it for because I have the local LLM setup running anyway. It wasn't the reason I bought it, but now that it's there I might just as well use it as much as I can.
- pizza234 16d ago> Oh no doubt. But one does have the guarantee that no bits left their home and that's a big one for some. No, this is a big misconception, and part of the cargo cult. Use cases like the parent's are essentially about having a local LLM handle the leftover tasks. By that point, a lot of bits (main/big tasks) have already left home anyway.
- wolvoleo 15d agoI'm just saying that's why I bought my local setup. I do use cloud but only for stuff where privacy is irrelevant.