7 ms·Or 4 thousand for the NVIDIA RTX A6000 which also runs the 120b just fine (quantized).by cfn 8mo agoOr 4 thousand for the NVIDIA RTX A6000 which also runs the 120b just fine (quantized).