4 ms·
Yet GPUs which take HT to the next level by having thousands of "hyper-threads" work very well for scientific computing.
by juggertao 3y ago
Yet GPUs which take HT to the next level by having thousands of "hyper-threads" work very well for scientific computing.
- pjmlp 3y agoTheir design is completly different, it isn't shared execution units like it happens on CPUs.
- juggertao 3y agoBut it is. GPUs have many more threads in flight than execution units.
- pjmlp 3y agoThreads groups get exclusive resources in SIMT execution pipelines.
- juggertao 3y agoAnd at memory stall they are exchanged with other waiting thread groups. Just like HT.
- RealHusky 3y agoScheduling algorithm is different. CPUs target low latency (they switch often). GPUs target high troughput (they switch rarely, only when needed). High troughput algorithms dont have problem with a lot of threads. Low latency algorithms have problem with a lot of threads (they need lot of cache memory because of constant switching).