5 ms·

vLLM-iOS: 88% Faster Multi-Agent Inference on iOS

• mips_avatar 22d ago
  Direct link to the repo on github: https://github.com/jonready/vllm-ios https://github.com/jonready/vllm-ios
• maestroquirk 22d ago
  super cool project! bravo!
  • mips_avatar 22d ago
    Thanks! It was really cool to work a layer deeper in the stack
• deleted 22d ago
  [deleted]