5 ms·
The only "math" in deep learning is given by reverse mode AD (or if you're into fancy stuff, "efficient computing of pullbacks"). The rest of it plain old hacki
by gnipgnip 10y ago
The only "math" in deep learning is given by reverse mode AD (or if you're into fancy stuff, "efficient computing of pullbacks"). The rest of it plain old hacking, and empirical tricks with the occasional variational doodads.
- AlexCoventry 10y agoYou clearly haven't read the book.
- gnipgnip 10y agoDon't need to when you read papers.
- AlexCoventry 10y agoYou clearly also haven't read many of the papers it cites. I would say one weakness of the book is that parts of it are too much like a survey of the papers in a subfield. Another is that it is very heavy on theory and light on practice (e.g., no exercises.)
- gnipgnip 10y agoOh really? Pray tell me, oh self-conceited one, what I missed that is both in actual use and in that book ? For things outside this set, you'd not read this book anyway; nor would such things be called "deep learning" (other than may be RBMs).