6 ms·
A recent paper [1] shows that what you're describing is possible to some degree - you can reproduce text from its embeddings. The paper provides the code implem
by wint3rmute 3y ago
A recent paper [1] shows that what you're describing is possible to some degree - you can reproduce text from its embeddings. The paper provides the code implementing the reversal process, so you could quickly hack together a prototype :)
I also recommend a video by Yannic Kilcher [2], explaining the paper.
[1] https://arxiv.org/abs/2310.06816 https://arxiv.org/abs/2310.06816
[2] https://www.youtube.com/watch?v=FY5j3P9tCeA https://www.youtube.com/watch?v=FY5j3P9tCeA
- two_in_one 3y agoisn't that how translation works in tranformers? encoder produces embedding then decoder generates the sentence. do it again with reverse translation and you get your text back in original language. combining two sentences can be done by using model for summary. making a cross-breed of two sentences is a different problem.