5 ms·

looks promising, but after looking at the website I'm yearning to learn more about it! How does it compare to alternatives? What's the performance like? There i

by raajg 3y ago

looks promising, but after looking at the website I'm yearning to learn more about it! How does it compare to alternatives? What's the performance like? There isn't enough to push me to stop using ChatGPT and use this instead. Offline is good, but to get users at scale there has to be a compelling reason to shift. I don't think that offline capabilities are going to be enough to get significant number of users. Another tip, I try out a new chat interface to LLMs almost every week and they're free to use initially. There isn't a compelling reason for me to spend $10 from the get to for a use case that I'm not sure about yet.

FloorEgg 3y ago
Maybe this isn't for everyone, just the people who place a high value on privacy.
- ukuina 3y ago
  But how can I guarantee this app is private? I'm assuming I cannot block internet access to the app because it needs to verify App Store entitlement.
- giblfiz 3y ago
  I mean, ok, then how do you distinguish yourself from LM Studio (Free)
- vunderba 3y ago
  If your ultimate goal is privacy, then you should only be looking at open source chat UI front ends: https://github.com/mckaywrigley/chatbot-ui https://github.com/mckaywrigley/chatbot-ui https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI And then connecting them to off-line models servers: - Ollama - llama.cpp And you should avoid closed source frontends: - Recurse - LM Studio And closed source models - ChatGPT - Gemini
  - copperx 3y ago
    Are you implying Claude is an open source model?
    - djfdat 3y ago
      I don't think the list was meant to be exhaustive.
bradnickel 3y ago
The compelling reason to shift to local/decentralized AI is that all of compute will soon be AI and that means your entire existence will go into it. The question you should ask yourself is do you want everything about you being handled by Sam Altman, Google, Microsoft, etc? Do you want all of your compute dependent on them always being up and do you want to trust their security team with your life? Do you want to still be using closed/centralized/hosted AI when truly open AI surpasses all of them in performance and capability. If you have children or family, do you want them putting their entire lives in the hands of those folks. Decentralized AI will eventually become p2p and swarmed and then the true power of agents and collaboration will soar via AI. Anyway, excuse the soap box, but there are zero valid reasons for supporting and paying centralized keepers of AI that rarely share, collaborate or give back to the community that made what they have possible.
- gverrilla 3y ago
  > when truly open AI surpasses all of them in performance and capability. Is this true? I've tried llama last year and it was not very helpful. GPT4 is already full of problems and I have to keep circumventing them, so using something less capable doesn't get me too excited.

by raajg 3y ago

FloorEgg 3y ago

Maybe this isn't for everyone, just the people who place a high value on privacy.

ukuina 3y ago
But how can I guarantee this app is private? I'm assuming I cannot block internet access to the app because it needs to verify App Store entitlement.
giblfiz 3y ago
I mean, ok, then how do you distinguish yourself from LM Studio (Free)
vunderba 3y ago
If your ultimate goal is privacy, then you should only be looking at open source chat UI front ends: https://github.com/mckaywrigley/chatbot-ui https://github.com/mckaywrigley/chatbot-ui https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI And then connecting them to off-line models servers: - Ollama - llama.cpp And you should avoid closed source frontends: - Recurse - LM Studio And closed source models - ChatGPT - Gemini
- copperx 3y ago
  Are you implying Claude is an open source model?
  - djfdat 3y ago
    I don't think the list was meant to be exhaustive.

bradnickel 3y ago

The compelling reason to shift to local/decentralized AI is that all of compute will soon be AI and that means your entire existence will go into it. The question you should ask yourself is do you want everything about you being handled by Sam Altman, Google, Microsoft, etc? Do you want all of your compute dependent on them always being up and do you want to trust their security team with your life? Do you want to still be using closed/centralized/hosted AI when truly open AI surpasses all of them in performance and capability. If you have children or family, do you want them putting their entire lives in the hands of those folks. Decentralized AI will eventually become p2p and swarmed and then the true power of agents and collaboration will soar via AI. Anyway, excuse the soap box, but there are zero valid reasons for supporting and paying centralized keepers of AI that rarely share, collaborate or give back to the community that made what they have possible.

gverrilla 3y ago
> when truly open AI surpasses all of them in performance and capability. Is this true? I've tried llama last year and it was not very helpful. GPT4 is already full of problems and I have to keep circumventing them, so using something less capable doesn't get me too excited.