4 ms·
Unfortunately on Strix Halo or any similar unified memory set up, dense models are gonna be dirt slow due to the tiny memory bandwidth... But I agree, 27B is su
by anana_ 3mo ago
Unfortunately on Strix Halo or any similar unified memory set up, dense models are gonna be dirt slow due to the tiny memory bandwidth... But I agree, 27B is superior.
- stymaar 3mo agoExactly. That's why I'm disappointed there wasn't a 122B version, it's 27B but for Strix Halo users.