6 ms·
You're describing the mac mini/studio with some facelift.
by Aperocky 2mo ago
You're describing the mac mini/studio with some facelift.
- boredatoms 2mo agoYeah but like running linux hopefully
- throw1234567891 2mo agoso you have invent unified memory for linux first because that’s the limitation today
- Alpha3031 2mo agoFairly sure most iGPUs these days are zero-copy and can dynamically allocate memory so what does "unified memory" mean to you exactly? A wider bus would be nice but it's not exactly a groundbreaking new invention.
- throw1234567891 2mo agoI was actually pretty far off: > Unified memory in Linux creates a single address space accessible to both the CPU and GPU, eliminating the need to manually copy data between system RAM and video memory. It is enabled via NVIDIA's CUDA, AMD's ROCm/HIP, or generic kernel-level Heterogeneous Memory Management (HMM). So it does exist and is available for platforms that matter.
- vkazanov 2mo agoIt is interesting how apple claimed that "unified memory" is something special, and ppl believed them. Intel and AMD had been doing this for years already, and had linux support for it from day 1.
- throw1234567891 2mo agoCool. Apple was the only one who managed to ship a consumer device with UMA and RDMA support. 2TB VRAM max over RDMA.
- vkazanov 2mo agoI think the REALLY cool thing about apple's shared memory implementation is the ultra-wide memory bus. Otherwise, AMD is quite close to what Apple has, and Strix Halo is honestly incredible. Not sure what RDMA brings to the table.
- throw1234567891 2mo agoRDMA increases the inference performance by a significant percentage across devices connected via Thunderbolt 5.4x512 is like a 2TB machine.
- boredatoms 2mo agoThunderbolt RDMA is slower and higher latency than if apple just gave us PCIe, where we could put a (old) connectX card in for infiniband
- vardump 2mo agoRaspberry Pi and other SBCs, Android phones and practically all of the embedded devices with a display and microprocessor. All have unified memory. Linux runs just fine on all of those.
- throw1234567891 2mo agoDude, https://news.ycombinator.com/item?id=48858095 https://news.ycombinator.com/item?id=48858095
- vardump 2mo agoAh ok. I replied to ~45 minutes stale page.
- curt15 2mo agoOr just buy a MI300A server like https://www.servethehome.com/gigabyte-g383-r80-aap1-amd-instinct-mi300a-server-review/ https://www.servethehome.com/gigabyte-g383-r80-aap1-amd-inst...
- throw1234567891 2mo ago"Just". And then GPUs, and RAM? And cooling? Will you really appreciate it when sitting right next to it?
- huragok 2mo agoAbsolutely, but not under the control of Apple.