6 ms·
let me know how is the PCIe bandwidth treating you
by klohto 2y ago
let me know how is the PCIe bandwidth treating you
- boroboro4 2y agoSince we’re talking about small batch sizes PCIe bandwidth isn’t as important - intermediate hidden state is magnitude smaller than weights.