5 ms·

There was a startup that did this for Llama 3, I forgot their name. Etched is also doing some similar things I believe.