5 ms·
wolfram alpha told me its: cos(x) - xsin(x) lol kidding, i had calculus 15 years ago. so it sounds I should recap derivatives.
by IWantToRelocate 5y ago
wolfram alpha told me its: cos(x) - xsin(x)
lol kidding, i had calculus 15 years ago. so it sounds I should recap derivatives.
- PaulHoule 5y agoThis book is a little old but you should learn whatever math it takes to understand it https://www.amazon.com/Networks-Recognition-Advanced-Econometrics-Paperback/dp/0198538642 https://www.amazon.com/Networks-Recognition-Advanced-Econome... Another oldie-but-goodie is https://www.amazon.com/Neural-Networks-Lecture-Computer-Science-ebook/dp/B00S16XFE8 https://www.amazon.com/Neural-Networks-Lecture-Computer-Scie... which tells the secret of when to stop when you're doing "early stopping", something I've seen many modern deep learners fail to get right. Off the top of my head I would say the fundamental math about deep networks is not really new. Most of the work in that field is pretty ad-hoc and not a lot is proven; probably people that are proving things are using difficult graduate-level math but you don't need to go there.
- IWantToRelocate 5y agothank you Paul for the references, will def take a look mainly in the early stopping problem.