5 ms·
Try to use less cores. RAM bandwidth is real limiting factor there, so there always some sweet spot between CPU cores and RAM bandwidth for individual system.
by Ambix 3y ago
Try to use less cores. RAM bandwidth is real limiting factor there, so there always some sweet spot between CPU cores and RAM bandwidth for individual system.
For example, I use only 6 cores from 10 on my M1 Pro laptop.
- cfn 3y agoThat is an interesting idea. Can you tell me what is the switch for number of cores?
- washadjeffmad 3y ago-t 32 Use a maximum of the number of physical cores and then scale down.
- cfn 3y agoThanks, -t 32 (instead of -t 13 which is what comes as default) makes a big difference in CPU usage across all cores. Not quite 100% but all cores are above 50% with many at 100%. It speeds up just a tiny bit the eval t/s to 3.3 (from 2.9).