6 ms·
Some[1] think that things are trending in the opposite direction: away from clever manipulations and hard coded domain knowledge, and towards large scale genera
by astroalex 2y ago
Some[1] think that things are trending in the opposite direction: away from clever manipulations and hard coded domain knowledge, and towards large scale general models.
[1]: http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html
- PoignardAzur 2y agoYeah, I was surprised to see the architecture diagram is so complex. It's been a while since I saw a design that wasn't just "stack more transformer layers".
- sangnoir 2y agoThis made me think of thr differences FPGAs and microprocessors - with "more laters" being equivalent to "more gates"