6 ms·
I've been doing some reading on LLMs for protein/RNA structure prediction and I think there's a decent amount of work on SO3 invariant transformer architectures
by mrdmnd 2y ago
I've been doing some reading on LLMs for protein/RNA structure prediction and I think there's a decent amount of work on SO3 invariant transformer architectures now
- mjhay 2y agoThere's also been some work on more general Lie-group equivariant transformer models. http://proceedings.mlr.press/v139/hutchinson21a/hutchinson21a.pdf http://proceedings.mlr.press/v139/hutchinson21a/hutchinson21...