6 ms·
I haven’t had much time with it, but I’ve had to set the split in the BIOS. There’s probably a way to do it from within Linux though. Also hoping some progress
by mrbuttons454 7mo ago
I haven’t had much time with it, but I’ve had to set the split in the BIOS. There’s probably a way to do it from within Linux though. Also hoping some progress is made on using the AMD NPU in Linux. I know it only recently got kernel level support.
- hedora 7mo agoI thought I had to split it in the BIOS, but then I just didn't (this is on a 2025 machine), and llama ended up with the same available "GPU" ram either way (confirmed by running inference on it).
- mrbuttons454 7mo agoOh that's fantastic, I'll give it a try. thank you!
- pstuart 7mo agoFinally there's good news for Linux users: https://github.com/FastFlowLM/FastFlowLM https://github.com/FastFlowLM/FastFlowLM
- mrbuttons454 7mo agoAmazing, thank you!