5 ms·
t5 is an architecture, t5x is a framework for training models that was created with that architecture in mind, but can be used to train other architectures, inc
by terafo 2y ago
t5 is an architecture, t5x is a framework for training models that was created with that architecture in mind, but can be used to train other architectures, including decoder-only ones(there is one in examples).
- ma2rten 2y agot5x was used to train PaLM 1.