6 ms·
Because bandwidth between those sticks and the GPU isn't fast enough for fast inference.
by smw 2mo ago
Because bandwidth between those sticks and the GPU isn't fast enough for fast inference.
- xyzsparetimexyz 2mo agoEven with an integrated gpu? Surely it'll be faster that using thunderbolt cables
- cyanydeez 2mo agoboth AMD and Apple hit the unified memory goal. but its the bandwith thats bottlenecking their performance and onboarc memory is even worse.
- xyzsparetimexyz 2mo agoIs Apple in a better position than Amd as this article seems to claim?
- wtallis 2mo agoAMD's Strix Halo has a 256-bit memory bus. Apple's Max class chips have a 512-bit memory bus, Ultra class chips have a 1024-bit memory bus. Unless you want to go for datacenter hardware, AMD's offerings simply aren't in the same league in terms of memory bandwidth.
- xyzsparetimexyz 2mo agoI see, interesting thank you
- cyanydeez 2mo agodepends: if they can keep getting larger memory, yes