5 ms·

I bought a Mac Studio with 128gb RAM and M4 Max a year ago for local LLMs. 96gb memory doesn’t seem to be sufficient?

• leptons 5mo ago
  What? 640K should be enough for anyone!