4 ms·
The two other changes they mention have been widely adopted, and are included in at least some of the models they benchmark against. It seems they list them for
by Chirono 2y ago
The two other changes they mention have been widely adopted, and are included in at least some of the models they benchmark against. It seems they list them for completeness as changes to the original transformer architecture.
- aDyslecticCrow 2y agoNicely spotted! Then, I really look forward to seeing this method tested by others! Epic stuff.