6 ms·
As an alternative for purely local LLMs, I've been having fun with this setup: https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/t
by a5huynh 3y ago
As an alternative for purely local LLMs, I've been having fun with this setup: https://github.com/oobabooga/text-generation-webui https://github.com/oobabooga/text-generation-webui
- specproc 3y agoThe oobabooga setup feels a lot more mature and has a larger community. Skimming OP's repo, there seems like a lot of fiddling and faffing with JSON to get things running. Nice stuff all the same.
- simion314 3y agoDo you know what is the way to find models compatible with oobabooga/text-generation-webui ? I downloaded one with the included script and that worked, but if I try different ones it seems there are so many formats so no idea say how do I search huggingface or google to find the correct format. I would like to try this new quantized LLAMA versions with the GUI, I can run them in the CLI on the CPU but llama.cpp uses ggml formats .
- enlyth 3y agohttps://rentry.org/nur779 https://rentry.org/nur779 (scroll down to the Huggingface ones)
- xenodium 3y agoNeat, eventually would like to run a purely local LLM Emacs shell https://github.com/xenodium/chatgpt-shell https://github.com/xenodium/chatgpt-shell. For now ChatGPT only, but working on making more generic/reusable.