234 ms·
Are we going to see SOTA local coding models anytime soon with this hardware or is it still long way to go?
by willahmad 11mo ago
Are we going to see SOTA local coding models anytime soon with this hardware or is it still long way to go?
- Etheryte 11mo agoYou can already do that, just how slow or fast you go depends on how much you're ready to pay for memory. It's a $1200 premium to go from 36GB to 128GB of unified memory, that cost is hard to justify unless you really need it, or if someone else is paying.
- willahmad 11mo agoNone is comparable to GPT-5 or Sonnet 4.5 experience
- mertbio 11mo agoYet.
- elzbardico 11mo agoFrankly, right now I am way more satisfied with qwen-3-coder-420 using Cerebras inference than with those more powerful models. Inference speed and fast feedback matter a lot more than perfect generation to me.