7 ms·

Show HN: a desktop app to discover, download, and run offline LLMs

• dtagames 3y ago
  Looks very useful! Can't wait to try the Windows version. Thanks!
  • ybu 3y ago
    Follow up: Windows release is out.
  • ybu 3y ago
    hopefully soon!
• pearlsteinj 3y ago
  Wow, this makes running LLMs locally significantly more approachable. Very cool!
  • leeholim 3y ago
    Agreed!
• deleted 3y ago
  [deleted]
• asselinpaul 3y ago
  This is great! CPU only for now or can it leverage GPU for sped up inference?
  • ybu 3y ago
    Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build https://github.com/ggerganov/llama.cpp#blas-build