TorToiSe is composed of many large models: GPT-2 for text encodings, as well as a large VQVAE encoder + large diffusion model decoder. Only the big spaghetti i

TorToiSe is composed of many large models: GPT-2 for text encodings, as well as a large VQVAE encoder + large diffusion model decoder. Only the big spaghetti inference code (+ weights) has been published, so there's a high entrance barrier for re-training / improving it.