6 ms·
Great looking project here. Absolutely need a local/FOSS option. There's been a number of open-source libraries for LLMs lately that simply call into paid/close
by txtai 4y ago
Great looking project here. Absolutely need a local/FOSS option. There's been a number of open-source libraries for LLMs lately that simply call into paid/closed models via APIs. Not exactly the spirit of open-source.
There's already great local/FOSS options such as FLAN-T5 (https://huggingface.co/google/flan-t5-base https://huggingface.co/google/flan-t5-base). Would be great to see a local model like that trained specifically for chat.
- mdaniel 4y agoI tried to find the source for https://github.com/LAION-AI/Open-Assistant/blob/v0.0.1-beta22/docker-compose.yaml#L192 https://github.com/LAION-AI/Open-Assistant/blob/v0.0.1-beta2... but based on the image inspector <https://hub.docker.com/layers/ykilcher/text-generation-inference/latest/images/sha256-87c28844bae7bf8168f9b9380e885af3a02d455c1a10f2929979eaf1e461db98?context=explore https://hub.docker.com/layers/ykilcher/text-generation-infer...> it seems to match up with https://github.com/huggingface/text-generation-inference/blob/v0.2.0/Dockerfile https://github.com/huggingface/text-generation-inference/blo...