visiondude

6 ms·

1. 31.▲
   by visiondude 1y ago

   LMStudio works surprisingly well on M3 Ultra 64gb and 27b models. Nice to have a local option, especially for some prompts.
2. 32.▲
   by visiondude 1y ago

   ^ seems like the way to go. open source and more features.
3. 33.▲
   by visiondude 1y ago

   always seemed to me that efficient caching strategies could greatly reduce costs… wonder if they cooked up something new
4. 34.▲
   by visiondude 1y ago

   They did!!! At least color options. Just announced at platform state of the union
5. 35.▲
   by visiondude 1y ago

   Excited to try these out and see benchmarks. Expectations for on device small local model should be pretty low but let’s see if Apple cooked up any magic here.