4 ms·
Two reasons (may not be well thought out or wrong): * Flash Attention, an efficient attention module which significantly speeds up training, only works on Ampe
by matroid 3y ago
Two reasons (may not be well thought out or wrong):
* Flash Attention, an efficient attention module which significantly speeds up training, only works on Ampere GPUs [1]
* Even if I bought a 3090, I would have to get a computer to go with it, along with a PSU and some cooling. Don't know where to start with that.
[1] https://github.com/Dao-AILab/flash-attention/issues/190 https://github.com/Dao-AILab/flash-attention/issues/190