5 ms·
Unlees you invest thousands your local ai won't even come close to the cheap cloud llms. Local is only worth it if you care about privacy or have a legitimate u
by jack_pp 2mo ago
Unlees you invest thousands your local ai won't even come close to the cheap cloud llms. Local is only worth it if you care about privacy or have a legitimate usage for the hardware otherwise. Money wise it isn't worth it
- nicman23 2mo agothe qwen 27b is quite good for doing a mvp
- Bender 2mo agoI think you bring up a good point about privacy. Companies probably should not be handing over intellectual property to cloud AI third party vendors. Perhaps all of that should stay on-prem and then the cloud vendors could be used to fill in the gaps.
- alchemism 2mo agoEnterprises running in public clouds have Zero Data Retention policies with the vendor. Routing the ai spend through Azure or AWS usually bring these policies along with it, ie enterprise data and useage is not ingested to retrain the model.
- arijun 2mo agoI mean, if you're using one of the $200/month plans, you'd recoup the cost in a year or two.
- TOMDM 2mo agoYou're not running an Opus 4.8/GPT 5.6 tier model on $5k of hardware at a useful Tok/s