4 ms·
PowerInfer-2: Fast Large Language Model Inference on a Smartphone
- 27theo 2y agoArxiv Paper: https://arxiv.org/abs/2406.06282 https://arxiv.org/abs/2406.06282 Previous submission (paper link submitted): https://news.ycombinator.com/item?id=40646450 https://news.ycombinator.com/item?id=40646450