You can run craiyon / dalle-mini on a card with 8GB of VRAM if you decrease batch size to 1 and skip the CLIP step. Takes about 7 sec to generate an image on a

You can run craiyon / dalle-mini on a card with 8GB of VRAM if you decrease batch size to 1 and skip the CLIP step. Takes about 7 sec to generate an image on a 3070. I started with https://github.com/borisdayma/dalle-mini/blob/main/tools/inference/inference_pipeline.ipynb https://github.com/borisdayma/dalle-mini/blob/main/tools/inf... and pared it down.