6 ms·

You are not crazy, you are just waking up from the SaaS delusion. We somehow allowed the industry to convince us that paying $20/month to rent volatile compute,

You are not crazy, you are just waking up from the SaaS delusion. We somehow allowed the industry to convince us that paying $20/month to rent volatile compute, have our proprietary workflows surveilled, and get throttled mid-thought is an 'upgrade'. The pendulum is swinging violently back to local-native tools. Deterministic, privately owned, unmetered—buying your execution layer instead of renting it is the only way to build actual leverage.

staticassertion 6mo ago
No one was convinced to spend money to do the things you're saying. That's just disingenuous. People rent models because (a) it moves compute elsewhere (b) they provide higher quality models.
- nprateem 6mo ago
  c) It's turnkey instead of requiring months/years of custom dev and on-going maintenance.
NoMoreNicksLeft 6mo ago
If I could buy this to run it locally, what's that hardware even look like? What model would I even run on the hardware? What framework would I need to have it do the things Claude Code can do?
- deleted 6mo ago
  [deleted]
muskstinks 6mo ago
I'm quite aware of my dependency and i'm balancing this in and out regularly over the last 10 years. Owning is expensive. Not owning is also expensive. Energy in germany is at 35 cent/kwh and skyrocketed to 60 when we had the russian problem. I'm planning to buy a farm and add cheap energy but this investment will still take a little bit of time. Until then, space is sparse.
lukewarm707 6mo ago
i don't use local llms. it's mostly the closed source subscriptions that are not private, it really is a choice. there are many cloud providers of zero data retention llm APIs, and even cryptographic attestation. they are not throttled, you can get an agreed rate limit.
- l72 6mo ago
  Would you mind naming some of your favorite providers?
  - lukewarm707 6mo ago
    API: fireworks Fast: inception labs or cerebras Confidential: tinfoil.sh, phala TTS/STT: groq Routers: vercel (or openrouter if they don't have the model). Search: unsolved, just can't get zdr, local hosted.

staticassertion 6mo ago

No one was convinced to spend money to do the things you're saying. That's just disingenuous. People rent models because (a) it moves compute elsewhere (b) they provide higher quality models.

nprateem 6mo ago
c) It's turnkey instead of requiring months/years of custom dev and on-going maintenance.

NoMoreNicksLeft 6mo ago

If I could buy this to run it locally, what's that hardware even look like? What model would I even run on the hardware? What framework would I need to have it do the things Claude Code can do?

deleted 6mo ago
[deleted]

muskstinks 6mo ago

I'm quite aware of my dependency and i'm balancing this in and out regularly over the last 10 years. Owning is expensive. Not owning is also expensive. Energy in germany is at 35 cent/kwh and skyrocketed to 60 when we had the russian problem. I'm planning to buy a farm and add cheap energy but this investment will still take a little bit of time. Until then, space is sparse.

lukewarm707 6mo ago

i don't use local llms. it's mostly the closed source subscriptions that are not private, it really is a choice. there are many cloud providers of zero data retention llm APIs, and even cryptographic attestation. they are not throttled, you can get an agreed rate limit.

l72 6mo ago
Would you mind naming some of your favorite providers?
- lukewarm707 6mo ago
  API: fireworks Fast: inception labs or cerebras Confidential: tinfoil.sh, phala TTS/STT: groq Routers: vercel (or openrouter if they don't have the model). Search: unsolved, just can't get zdr, local hosted.