I don't think that the 'lossy' part is the problem. Instead, the problem is that language is only a subset of the human experience. So there are aspects that ar

I don't think that the 'lossy' part is the problem. Instead, the problem is that language is only a subset of the human experience. So there are aspects that are not included when training models based on language. Making the models multi-modal helps to close that gap, but it still exists. But ultimately this is just a matter of training data. I do not say that it is easy to obtain the required data, but it is not a fundamental problem LLMs can't overcome.