5 ms·
I have M5, but diffusion is a bad fit for metal: https://eamag.me/2026/why-parallel-diffusion-llms-are-slow-on-a-mac https://eamag.me/2026/why-parallel-diffusio
by eamag 28d ago
I have M5, but diffusion is a bad fit for metal: https://eamag.me/2026/why-parallel-diffusion-llms-are-slow-on-a-mac https://eamag.me/2026/why-parallel-diffusion-llms-are-slow-o...
- mmastrac 28d agoThat's mostly correct, but I believe the INT8 support on M5 changes the equation pretty drastically. I also believe that diffusion models generally output _better_ results if they have shaping for code (they often will miss delimiter matching inside of a canvas).