4 ms·
I really wish people developing local applications would allow users to specify an API endpoint. Most applications use an OpenAI compatible API, and if they don
by codercowmoo 2y ago
I really wish people developing local applications would allow users to specify an API endpoint. Most applications use an OpenAI compatible API, and if they don't the browser's implementation of local model inference can be used.
- CharlesW 2y agoI've also been looking for an "LLM browsers" for iOS, i.e. apps which can work with LLM endpoints that I host, but I haven't been able to find anything.