5 ms·
Really interesting framework for thinking about backend systems. I've been messing around with LLMs, and there's a real need to check and constrain outputs whe
by datadr 3y ago
Really interesting framework for thinking about backend systems. I've been messing around with LLMs, and there's a real need to check and constrain outputs when building anything rigorous. I've only been working through static workflows, but can imagine it only gets more complex if the workflow changes dynamically based on the LLM output. I wonder if this state-machine-based back end is a good way to better manage that.
- abrgr 3y agoGreat point! State machines are a really nice way to orchestrate multi-step LLM invocations. They're also a great way for LLMs to produce code. It's human-readable so you can vet that it's doing what you want it to and it's high-level enough that the remaining bits to fill in tend to be small functions that AI can easily generate.