6 ms·

I am wondering why flash attention is like 5x slower with variable masking than without it? Lack of good masking support almost zeros out the optimizations

• chillee 2y ago
  Where are you seeing these benchmarks?