A sentence is both a sequence and a tree of phrases. Phrases have a head and one or more valents; they’re relations. If you wanted to create an embedding alg

A sentence is both a sequence and a tree of phrases. Phrases have a head and one or more valents; they’re relations. If you wanted to create an embedding algorithm for phrases, you could and you could throw a transformer at it. I don’t know how you get the output of higher levels to diffuse to phrase and word levels.