7 ms·

Can one enter their own opeanai URL and api-key? (so we can use openai-compatible things like openrouter or lm-studio)?

• nullstyle 3y ago
  Doesn't look like it: https://gitlab.com/literally-useful/voxos/-/blob/dev/voxos/services/agents.py?ref_type=heads#L34 https://gitlab.com/literally-useful/voxos/-/blob/dev/voxos/s... edit: shouldn't be hard to enable though
• Falimonda 3y ago
  Yes, you can define your own key in either the .env, CLI call on run.sh, or in your environment. https://gitlab.com/literally-useful/voxos/-/blob/dev/.env?ref_type=heads#L11 https://gitlab.com/literally-useful/voxos/-/blob/dev/.env?re...
  • nullstyle 3y ago
    That doesn't let me send requests to my local litellm instance, though. You have to be able to configure the endpoint that requests are sent against as well.
    • Falimonda 3y ago
      Nice. LiteLLM was just the thing I've been looking for and hoping to integrate.
      • nullstyle 3y ago
        Hell yeah. Good luck!
        • Falimonda 3y ago
          Do you know if there's anything out there like LiteLLM that includes OpenAI's whisper model? I took a look at the litellm package and it doesn't appear they support the audio module. :/
          • nullstyle 3y ago
            I'm not sure if it is _fully_ openai compatible, but whispercpp has a server bundled that says it is "OAI-like": https://github.com/ggerganov/whisper.cpp/tree/master/examples/server https://github.com/ggerganov/whisper.cpp/tree/master/example... I don't have any direct experience with it... I've only played around with whisper locally, using scripts.
          • khimaros 3y ago
            https://github.com/mudler/LocalAI https://github.com/mudler/LocalAI