8 ms·
I think the REALLY cool thing about apple's shared memory implementation is the ultra-wide memory bus. Otherwise, AMD is quite close to what Apple has, and Str
by vkazanov 2mo ago
I think the REALLY cool thing about apple's shared memory implementation is the ultra-wide memory bus.
Otherwise, AMD is quite close to what Apple has, and Strix Halo is honestly incredible.
Not sure what RDMA brings to the table.
- throw1234567891 2mo agoRDMA increases the inference performance by a significant percentage across devices connected via Thunderbolt 5.4x512 is like a 2TB machine.
- boredatoms 2mo agoThunderbolt RDMA is slower and higher latency than if apple just gave us PCIe, where we could put a (old) connectX card in for infiniband