9 ms·
Gradient descent is just how neural networks (including auto-encoders) optimize parameters to minimize the loss function. They do this using derivatives to desc
by crosen99 4y ago
Gradient descent is just how neural networks (including auto-encoders) optimize parameters to minimize the loss function. They do this using derivatives to descend down the slope of the function. Autodiff is one way to compute the derivatives. Maybe we’re saying the same thing.
- macrolocal 4y agoYep, I was just asking Adam* to justify his loss function. *pun intended :)