5 ms·
MFU is probably the best but requires application logic. You can export metrics at the infra level like SM efficiency. We explain it a bit how we used it to do
by asaiacai 1y ago
MFU is probably the best but requires application logic. You can export metrics at the infra level like SM efficiency. We explain it a bit how we used it to do some optimization.
https://www.trainy.ai/blog/gpu-utilization-misleading https://www.trainy.ai/blog/gpu-utilization-misleading