I am not sure if this was the very first paper talking about attention, but https://arxiv.org/abs/1409.0473 https://arxiv.org/abs/1409.0473 from 2014 is a famou

I am not sure if this was the very first paper talking about attention, but https://arxiv.org/abs/1409.0473 https://arxiv.org/abs/1409.0473 from 2014 is a famous one. What is still missing there, is the idea of self-attention.