5 ms·
And why not the GPUs themselves? Which inherent limitations do they have? Aren't they essentially general purpose parallel devices?
by snrji 7y ago
And why not the GPUs themselves? Which inherent limitations do they have? Aren't they essentially general purpose parallel devices?
- gbrown 7y agoNo, GPUs are quite different than CPUs with more cores. They're optimized for Singl-Instruction-Multiple-Data algorithms, in which the same operation is done at the same time to many different inputs (think image or video processing). They do very poorly in cases with complex branching logic.
- snrji 7y agoI know, but isn't that what the OP was asking for? Isn't that an inherent tradeoff? Or: isn't that what Neuromorphic hardware and deep learning are about (ie. composing many relatively simple functions without complex branching/logic)?