9 ms·
Excited to give this a try! A visual environment seems like a natural fit for chained LLM calls. Have you considered supporting OSS LLMs? Inference servers lik
by virtuallyvivek 3y ago
Excited to give this a try! A visual environment seems like a natural fit for chained LLM calls.
Have you considered supporting OSS LLMs? Inference servers like LocalAI or vLLM expose APIs for various OSS models with OpenAI-compatible endpoints, so might not be much more work to integrate.
- ajhai 3y agoWe recently opensourced a similar platform for building workflows by chaining LLMs visually along with LocalAI support. Check it out at https://github.com/trypromptly/LLMStack https://github.com/trypromptly/LLMStack. Like you said, it was fairly easy to integrate LocalAI and is a great project.
- gogwilt 3y agoNice! Love this!
- gogwilt 3y agoThanks! And yes, we'd love to support OSS LLMs. And we welcome contributions ;) Rivet also has a plug-in system, and our friends at AssemblyAI were actually able to develop a plug-in for using their audio transcription and understanding AI models in Rivet!