6 ms·
Possibly the original X tweet that popularized this list? 2024, 876k views https://x.com/keshavchan/status/1787861946173186062 https://x.com/keshavchan/status/
by amemi 2mo ago
Possibly the original X tweet that popularized this list? 2024, 876k views
https://x.com/keshavchan/status/1787861946173186062 https://x.com/keshavchan/status/1787861946173186062
In my opinion, whether it was actually by Ilya or not is not worthy of debate. Many of them are widely recognized for being good pedagogical resources (e.g. annotated transformer, unreasonable effectiveness of RNNs, understanding LSTM networks), and others are landmark papers which anyone interested in the field would benefit from reading:
- Krizhevsky et al. (2012) introduced AlexNet
- Bahdanau et al. (2014) introduced attention
- He et al. (2015) introduced ResNet
- Vaswani et al. (2017) introduced the Transformer
Other papers are more specialized. Of them, I think Kaplan et al. (2020) by OpenAI is probably most important.
- gekoxyz 2mo agoEven if Ilya didn't really create this list I have a very good opinion about every paper on this page that I've read (most of them) so I think it's a great resource. Lately during my off time I want to do something related to AI research (which I am already doing full time atm so I need something light) and I am for sure going to read through this.