8 ms·
I have a BS in CS (and have been in the field for 25 years). I couldn't understand the transformer architecture until I built a few myself. Here are the books I
by LatencyKills 3mo ago
I have a BS in CS (and have been in the field for 25 years). I couldn't understand the transformer architecture until I built a few myself. Here are the books I worked through. I now feel I have a very good understanding of modern LLMs.
https://www.amazon.com/Build-Large-Language-Model-Scratch/dp/B0DNR6TH6X https://www.amazon.com/Build-Large-Language-Model-Scratch/dp...
https://www.amazon.com/Build-DeepSeek-Scratch-Abhijit-Dandekar-ebook/dp/B0GJ75VLPS https://www.amazon.com/Build-DeepSeek-Scratch-Abhijit-Dandek...
- tinktank 3mo agoHas it given you enough of an understanding that you can pick up and follow research papers or did you have to do more to achieve that?
- LatencyKills 3mo agoI went this route because I had difficulty visualizing the content of the Attention Is All You Need paper. After going through both books, I can now understand every part of that paper. I'm currently working on a robotics project that uses Nvidia's GR00T N1 model, and I was able to understand the research paper. [0] [0]: https://arxiv.org/abs/2503.14734 https://arxiv.org/abs/2503.14734
- tinktank 3mo agoThank you for the information.