5 ms·
The Jetsons[1] have unified memory[2]. [1] https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/ https://www.nvidia.com/en-us/autonomous-machines/
by ajuhasz 1y ago
The Jetsons[1] have unified memory[2].
[1] https://www.nvidia.com/en-us/autonomous-machines/embedded-systems/ https://www.nvidia.com/en-us/autonomous-machines/embedded-sy...
[2] https://www.nvidia.com/en-us/on-demand/session/gtcspring22-se2600/ https://www.nvidia.com/en-us/on-demand/session/gtcspring22-s...
- tonyarkles 1y agoThey sure do and it's pretty amazing. One iteration of a vision system I worked on got frames from a camera over a Mellanox NIC that supports RDMA (Rivermax), preprocessed the images using CUDA, did inference on them with TensorRT, and the first time a single byte of the inference pipeline hit the CPU itself was when we were consuming the output.