9 ms·
8x RTX PRO 6000 or 4x Spark? Or 1x M5 Ultra 512GB. The model is theoretically FP8, but really internally its mostly FP4 already, so there won't be a cut-in-hal
by aenis 7d ago
8x RTX PRO 6000 or 4x Spark? Or 1x M5 Ultra 512GB.
The model is theoretically FP8, but really internally its mostly FP4 already, so there won't be a cut-in-half-but-almost-just-as-good quant coming for this one.