6 ms·
Most of the time, the speed of these models are constrained by memory bandwidth. GPUs normally have much more memory bandwidth.
by jboss10 2mo ago
Most of the time, the speed of these models are constrained by memory bandwidth. GPUs normally have much more memory bandwidth.
- davedx 2mo agoI'd expect the memory bandwidth to be the same for the CPU and GPU under a unified memory architecture like Apple silicon uses?