5 ms·
The GPU product page: https://www.nvidia.com/en-us/design-visualization/rtx-4000-sff/ https://www.nvidia.com/en-us/design-visualization/rtx-4000-s... 20GB RAM,
by binarymax 3y ago
The GPU product page: https://www.nvidia.com/en-us/design-visualization/rtx-4000-sff/ https://www.nvidia.com/en-us/design-visualization/rtx-4000-s...
20GB RAM, can fit 13B param models, and maybe some quantized larger models.