That’s why you have encoders as well as decoders. For example, another model from Meta does this for translations; they have encoders and decoders into a single

That’s why you have encoders as well as decoders. For example, another model from Meta does this for translations; they have encoders and decoders into a single embedding space that represents semantic concepts for each language https://ai.meta.com/research/publications/sonar-sentence-level-multimodal-and-language-agnostic-representations/ https://ai.meta.com/research/publications/sonar-sentence-lev...