4 ms·
"And hence invertible" <- does every output embedding combination have an associated input ? Are they able to construct it or is this just an existence result ?
by nephanth 11mo ago
"And hence invertible" <- does every output embedding combination have an associated input ? Are they able to construct it or is this just an existence result ?
- morcus 11mo agoI don't think they're claiming surjectivity here. They're just saying the mapping is injective, so for a given output there should be a unique input to construct it.
- RossBencina 11mo ago> I don't think they're claiming surjectivity here. What definition of invertible doesn't include surjectivity?
- diffeomorphism 11mo agoMany? Just add a "by restricting to the image, we may wlog assume surjectivity". The question is usually more about whether the inverse is also continuous, smooth, easy to compute....etc.
- deleted 11mo ago[deleted]
- thaumasiotes 11mo ago> Building upon this property, we further provide a practical algorithm, SɪᴘIᴛ, that reconstructs the exact input from hidden activations