7 ms·

I am using Mac studios for local inference, but not for openclaw. It was simply the best bang for the buck at the time, and the software side of things has gott

by srslack 18d ago

I am using Mac studios for local inference, but not for openclaw. It was simply the best bang for the buck at the time, and the software side of things has gotten even better since then. I haven’t run the pricing comparison but I have a feeling with the direction they’re heading that it’s better to hold off for m6 as it may assuage various bottlenecks if you are latency sensitive.

bredren 18d ago
Reportedly, the M6 will not get pro, max or ultra editions. Instead Apple will go straight to M7 for these.
- pylotlight 18d ago
  Some reporting seems to reject that btw: https://wccftech.com/apple-m6-pro-m6-max-soic-mh-wmcm-packaging-report/ https://wccftech.com/apple-m6-pro-m6-max-soic-mh-wmcm-packag...
- giantrobot 17d ago
  The Pro, Max, and Ultra chips boil down to different combinations of their "Super", performance, and efficiency cores along with the number of GPU cores. The Max is two Pros bolted together. Thus far they've skipped generations of Ultra chips but Pro and Max versions of all the M-series chips have been released. I can see them not releasing an M6 Ultra but no reason not to see Pro and Max versions of the M6.
ActorNightly 17d ago
>It was simply the best bang for the buck at the time, I wouldn't have a problem with Apple fanboys if they just stated that they like Macs, but for some reason you have no problem with just straight up LYING. Or at least being so deluded that you state things that are so easy to prove false as fact. I.e, 600 gb/sec is dogshit slow compared to vram speeds.
- srslack 17d ago
  You could not get 500GB of VRAM for less than $100k at the time. It was the absolute best bang for the buck as far as local inference and fine tuning. I am not sure why you are so hostile when I specifically called out “latency sensitivity” as far as prompt preprocessing and various other bottlenecks. I run Linux.
  - ActorNightly 16d ago
    The reason Im so hostile is because it personally irks me when a technical forum like HN is filled with Apple-slop being passed off as technical discussion. Its fine to like Apple for what it is, the ecosystem, the industrial design, the advantages of dedicated hardware with specialized software to extend battery life. But instead, there is Apple-slop, which is basically starting with the assumption that whatever you can do on Mac is the standard, and that Macs are great because they fit that standard. Being able to run frontier models at <10 tok/sec is just an excersize in showing that you can afford a Mac. Its useless for any real tasks. Gemma4 is on par with a lot of the older frontier models like Gemini Flash, and you can run that at 100+ tok/sec on a 2x3090 rig which costs way less than even top of the line Mac Studio.

by srslack 18d ago

bredren 18d ago

Reportedly, the M6 will not get pro, max or ultra editions. Instead Apple will go straight to M7 for these.

pylotlight 18d ago
Some reporting seems to reject that btw: https://wccftech.com/apple-m6-pro-m6-max-soic-mh-wmcm-packaging-report/ https://wccftech.com/apple-m6-pro-m6-max-soic-mh-wmcm-packag...
giantrobot 17d ago
The Pro, Max, and Ultra chips boil down to different combinations of their "Super", performance, and efficiency cores along with the number of GPU cores. The Max is two Pros bolted together. Thus far they've skipped generations of Ultra chips but Pro and Max versions of all the M-series chips have been released. I can see them not releasing an M6 Ultra but no reason not to see Pro and Max versions of the M6.

ActorNightly 17d ago

>It was simply the best bang for the buck at the time, I wouldn't have a problem with Apple fanboys if they just stated that they like Macs, but for some reason you have no problem with just straight up LYING. Or at least being so deluded that you state things that are so easy to prove false as fact. I.e, 600 gb/sec is dogshit slow compared to vram speeds.

srslack 17d ago
You could not get 500GB of VRAM for less than $100k at the time. It was the absolute best bang for the buck as far as local inference and fine tuning. I am not sure why you are so hostile when I specifically called out “latency sensitivity” as far as prompt preprocessing and various other bottlenecks. I run Linux.
- ActorNightly 16d ago
  The reason Im so hostile is because it personally irks me when a technical forum like HN is filled with Apple-slop being passed off as technical discussion. Its fine to like Apple for what it is, the ecosystem, the industrial design, the advantages of dedicated hardware with specialized software to extend battery life. But instead, there is Apple-slop, which is basically starting with the assumption that whatever you can do on Mac is the standard, and that Macs are great because they fit that standard. Being able to run frontier models at <10 tok/sec is just an excersize in showing that you can afford a Mac. Its useless for any real tasks. Gemma4 is on par with a lot of the older frontier models like Gemini Flash, and you can run that at 100+ tok/sec on a 2x3090 rig which costs way less than even top of the line Mac Studio.