6 ms·
”Run your own text to image prompts with CUDA, a bunch of disk space, and an insane amount of memory.” The ”insane amount of memory” turned out to be 32 GB or
by illuminati1911 4y ago
”Run your own text to image prompts with CUDA, a bunch of disk space, and an insane amount of memory.”
The ”insane amount of memory” turned out to be 32 GB or more. I thought we are talking about 512 GB or something like that.
- pwillia7 4y agoincluding the GPU memory I say it's insane :) -- Also, you need more than 32GB of RAM to follow the instructions verbatim in the repository. People were saying the scann indexing fails even with 64GB of RAM.
- Tepix 4y agoMany AM4 boards that cost 70€ or so support 128GB RAM. 128GB = 4x 32GB DDR4 UDIMM costs less than 360€. That's a lot less than the GPU.
- throwaway743 4y agoiirc any CUDA requirement requires an Nvidia GPU
- Tepix 4y agoYou can plug nVidia GPUs in AMD boards...
- throwaway743 4y agoYeah but that's out of the context of multiple am4 boards and their RAM caps being able to replace a GPU or being cheaper than a GPU. Yeah they're technically cheaper than a GPU, but your costs are still gonna be up and they can't replace a GPU because regardless you'll need an nvidia card, unless there's a workaround for CUDA requirements.
- Tepix 4y agoI thought you need both a GPU and a lot of memory for the CPU.
- pwillia7 4y agotru
- OhNoNotAgain_99 4y agoComputing neural nets isnt something a CPU is optimized for (matrix calculations), This tech is based on gpu optmized LSTM's, acka Transformers, they can run on cuda, reducing time. GPU's perform those calculations fast for huge matrixes. Doing it on a CPU (they're no good in fat matrix caclulations) it takes forever. And yes.. essentially those neural nets are extreme huge matrixes with some predictive math in between.