5 ms·
It has been more formally studied in signSGD[0], and empirically it's comparable to Adam in terms of behavior. [0]: https://arxiv.org/pdf/1802.04434 https://ar
by f_devd 2y ago
It has been more formally studied in signSGD[0], and empirically it's comparable to Adam in terms of behavior.
[0]: https://arxiv.org/pdf/1802.04434 https://arxiv.org/pdf/1802.04434