4 ms·they mention similar performance to vanilla transformer with significantly reduced param count thoughby lennxa 2y agothey mention similar performance to vanilla transformer with significantly reduced param count though