5 ms·

I guess I was more thinking about self attention, so yes. The more general case is covered by your notation!