5 ms·
Can you share the specific part of this work that demonstrates better scaling than original transformers? Also note that many of the changes to that architectur
by spindump8930 3mo ago
Can you share the specific part of this work that demonstrates better scaling than original transformers? Also note that many of the changes to that architecture, that have been proven in their use at actual scale, were brought about by members of the original team. Most notably Noam Shazeer.