7 ms·Speculative Decoding: The Free Speed Toggle Your Local LLM Is Probably Not Using4 points by ermantrout 2mo ago