6 ms·
New Fast.ai Course: A Code-First Introduction to Natural Language Processing
- Qiu_Zhanxuan 7y agoThank you so much to all the people at fast.ai! This is exactly what I was looking for!
- lelima 7y agoI though this post was about the course from two weeks ago, for my surprise this is a new one! Christmas in July! :)
- candeira 7y agoOh thank you, thank you!
- codecrusade 7y agoThank You Fast AI- I am indebted.
- jahbrewski 7y agoI just started the fast.ai MOOC (practical deep learning for coders), and boy, I much prefer reading through a tutorial than sitting through hours upon hours of videos. I looked for transcripts and/or a written version of the content and came up empty-handed. Can anyone recommend a solid, written, introduction, covering similar material?
- sputknick 7y agoMaybe read their code and it's associated comments would help you? One of the benefits of using notebooks over a traditional IDE is that code is segmented into blocks. For me it makes it easier to read. it's like "ok, this cell will do this to our data, then this next cell will do this to our data". It's been more than a year since I took their class, and what I did to help with comprehension of the videos was to take notes in the individual cells while following the videos.
- source99 7y agoJust my opinion but the fast.ai source code is very difficult to read.
- jsty 7y agoFor at least some of the lessons there are pretty comprehensive notes / transcripts linked in the column on the right. E.g. for https://course.fast.ai/videos/?lesson=2 https://course.fast.ai/videos/?lesson=2 there is https://github.com/hiromis/notes/blob/master/Lesson2.md https://github.com/hiromis/notes/blob/master/Lesson2.md
- thellamafarm2 7y agoWhat is your skillset? What language?
- dragandj 7y ago(My own writings) Deep Learning from Scratch to GPU at https://dragan.rocks https://dragan.rocks Deep Learning for Programmers (book in progress) at https://aiprobook.com/deep-learning-for-programmers https://aiprobook.com/deep-learning-for-programmers
- EForEndeavour 7y agoProject idea: use the NLP skills taught in this course to build an automated system that converts the course's videos into a written tutorial.
- thijsvandien 7y agoI have the same problem with video courses. The moment I start to sit and watch, I feel drowsy. It's strange, because I never had it so bad in real life lectures. Did anyone experience the same and find a way to fix themselves?
- manojlds 7y agoThe Coursera DeepLearning.ai course is very well done.
- bbrian 7y agoI discovered Udemy's 1.25x and 1.5x speed last week. It certainly helped.
- alohia 7y agoUse this chrome extension to increase video speeds on all sites: https://chrome.google.com/webstore/detail/video-speed-controller/nffaoalbilbmmfgbnbgppjihopabppdk https://chrome.google.com/webstore/detail/video-speed-contro...
- gumby 7y agoMy gf worked for Coursera for a while so I tried some of their courses. The big win for me was that every one I tried included a full transcript. So my use model was to simply read the transcripts and if I didn't understand something I clicked on the text which would jump to that point in the video. But in general for the stuff I want to learn I prefer to read a book, which is harder to find for really recent stuff like this.
- codesushi42 7y agoYes. An Introduction to Statistical Learning https://github.com/tpn/pdfs/blob/master/An%20Introduction%20To%20Statistical%20Learning%20with%20Applications%20in%20R%20(ISLR%20Sixth%20Printing).pdf https://github.com/tpn/pdfs/blob/master/An%20Introduction%20... Deep Learning https://books.google.com/books/about/Deep_Learning.html?id=omivDQAAQBAJ&printsec=frontcover&source=kp_read_button https://books.google.com/books/about/Deep_Learning.html?id=o... Machine Learning Mastery books https://machinelearningmastery.com/products/ https://machinelearningmastery.com/products/ Convolutional Neural Networks from the Ground Up https://towardsdatascience.com/convolutional-neural-networks-from-the-ground-up-c67bb41454e1 https://towardsdatascience.com/convolutional-neural-networks... Transformers https://medium.com/inside-machine-learning/what-is-a-transformer-d07dd1fbec04 https://medium.com/inside-machine-learning/what-is-a-transfo...
- jointpdf 7y agoFor deep learning / neural networks, I think these are the best balance of theory and practice (not to mention great visualizations): http://cs231n.github.io http://cs231n.github.io More on the intuition/theory side for NNs, but Michael Nielsen’s book is highly recommended: http://neuralnetworksanddeeplearning.com http://neuralnetworksanddeeplearning.com For NLP, you can try this extremely slick interactive course on spaCy (highly recommended Swiss Army knife library for NLP) from package author Ines Montani: https://course.spacy.io https://course.spacy.io The Keras tutorials are solid, here’s one on seq2seq models: https://blog.keras.io/a-ten-minute-introduction-to-sequence-to-sequence-learning-in-keras.html https://blog.keras.io/a-ten-minute-introduction-to-sequence-... For more cutting edge NLP, it looks like the fast.ai course covers the Transformer model (the basis of BERT, GPT-2, et al. This is a great overview of that architecture: http://nlp.seas.harvard.edu/2018/04/03/attention.html http://nlp.seas.harvard.edu/2018/04/03/attention.html And PyTorch implementations of Transformer models can be found here: https://github.com/huggingface/pytorch-pretrained-BERT/blob/master/README.md https://github.com/huggingface/pytorch-pretrained-BERT/blob/... LMK if anyone wants more, I have a learning resource hoarding problem.
- bllguo 7y agounfortunately the cs231n notes are not complete w.r.t the course itself. But what does exist is quite nice indeed
- throwaway321546 7y agohttps://www.deeplearningbook.org/ https://www.deeplearningbook.org/ is also great
- deleted 7y ago[deleted]
- jimmy_f 7y agoThanks for releasing this, can’t wait to start. Are there any plans for a fast.ai computer vision course?