7 ms·
Big ole pool of very fast ram that can be accessed by the CPU and GPU. Lets you run larger models. AMD does the same thing with Strix Halo. I have a 128gb machi
by AbsurdCensor 22d ago
Big ole pool of very fast ram that can be accessed by the CPU and GPU. Lets you run larger models. AMD does the same thing with Strix Halo. I have a 128gb machine at home, and have had difficulties running 120b models, but 70b and below run pretty well.
- dannyw 22d agoAMD Strix Halo unified memory still requires allocating X to GPU, x to CPU at UEFI. So not as flexible as apple's unified memory.
- EgregiousCube 22d agoNot in Linux! See setting GTT: https://rocm.docs.amd.com/en/docs-7.2.0/how-to/system-optimization/strixhalo.html https://rocm.docs.amd.com/en/docs-7.2.0/how-to/system-optimi...
- Havoc 22d ago> Big ole pool of very fast ram It’s more that it’s a very parallel architecture than fast. The LPDDR5X under the hood is slower than what you’d find in a graphics card vram of years ago That’s why you get consumer macs with 512gb while GPU makers are reluctant to give you more than 16gb unless you pay dearly. It’s not the same kind of mem