7 ms·Why do LLMs attend to the first token?2 points by adhi01 1y agomaytc 1y agoCurious if the authors had a chance to look at the Softpick paper? https://arxiv.org/abs/2504.20966 https://arxiv.org/abs/2504.20966