9 ms·
Hmmm… http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html
by snake_doc 1y ago
Hmmm… http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html
- whimsicalism 1y agothis is a bad example to claim the bitter lesson applies to, it’s about the fundamentals of optimization techniques not about tying to hand-crafted things for the solution space.
- snake_doc 1y agoAren’t they all optimization techniques at the end of the day? Now you’re just debating semantics
- whimsicalism 1y agobelieve what you want, i guess
- deleted 1y ago[deleted]
- ACCount37 1y agoDoesn't apply as long as the improvements obtained there scale with compute. Now, are there actual meaningful improvements to obtain, and do they stick around all the way to frontier runs? Unclear, really. So far, it looks like opening a can of hyperparameters.