Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
jaymody
searching Neon…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
8 ms
·
1.
▲
by
jaymody
3y ago
I wrote an article that attempts to explain attention in a more intuitive manner, without any PyTorch or other deep learning specific context: https://jaykmody.com/blog/attention-intuition/
2.
▲
by
jaymody
3y ago
I wrote a minimal implementation in NumPy here (the forward pass code is only 40 lines): https://github.com/jaymody/picoGPT And also a related blog post: https://news.ycombinator.com/item?id=34726115 A