My personal theory is that it’s an emergent property of many attention heads working together. If each attention head is a bird, reasoning would be the movement

My personal theory is that it’s an emergent property of many attention heads working together. If each attention head is a bird, reasoning would be the movement of the flock.