7 ms·
Hi Jeff, I'm a linux ambassador for Framework and I have one of these units. It'd be interesting if you would install ramalama in fedora and test that. I've bee
by jcastro 1y ago
Hi Jeff, I'm a linux ambassador for Framework and I have one of these units. It'd be interesting if you would install ramalama in fedora and test that. I've been using that out of the box as a drop in replacement for ollama and everything was GPU accelerated out of the box. It pulls rocm from a container and just figures it out, etc. Would love to see actual numbers though.
Great work on this!
- nicolaslem 1y agoI gave it a try on my Strix Halo laptop on Arch. ROCm and everything else worked out of the box with two commands: uv tool install ramalama ramalama serve <model>