5 ms·Trying to scale text inference to 1 million tok/s on cheap hardware.by pinstripes 3mo agoTrying to scale text inference to 1 million tok/s on cheap hardware.