6 ms·
I’m looking forward to trying this currently Strix halo’s npu isn’t accessible if you’re running Linux, and previously I don’t think lemonade was either. If thi
by kouunji 6mo ago
I’m looking forward to trying this currently Strix halo’s npu isn’t accessible if you’re running Linux, and previously I don’t think lemonade was either. If this opens up the npu that would be great! Resolute raccoon is adding npu support as well.
- dennemark 6mo agoMaybe you have seen NPU support via FLM already: https://lemonade-server.ai/flm_npu_linux.html https://lemonade-server.ai/flm_npu_linux.html "FastFlowLM (FLM) support in Lemonade is in Early Access. FLM is free for non-commercial use, however note that commercial licensing terms apply. "
- boomskats 6mo agoI thought the NPU has been available since something like 6.12?
- cpburns2009 6mo agoThe NPU works on Linux (Arch at least) on Strix Halo using FastFlowLM [1]. Their NPU kernels are proprietary though (free up to a reasonable amount of commercial revenue). It's neat you can run some models basically for free (using NPU instead of CPU/GPU), but the performance is underwhelming. The target for NPUs is really low power devices, and not useful if you have an APU/GPU like Strix Halo. [1]: https://github.com/FastFlowLM/FastFlowLM https://github.com/FastFlowLM/FastFlowLM