5 ms·
Can someone explain what they use structured output for? I’m just curious what kinds of use cases people have found for it.
by minzi 3y ago
Can someone explain what they use structured output for? I’m just curious what kinds of use cases people have found for it.
- StackOverlord 3y agoI use it to create a narrative plan for multiple interleaved plots in an open-world interactive fiction. For instance: https://pastebin.com/QFZmEAJA https://pastebin.com/QFZmEAJA I use Clojure's EDN JSON-equivalent format, and what you can read in this paste is an attempt to make GPT write its own prompt in a conversation where I gradually built a format for this narrative structure using Clojure. It turns out GPT isn't able to produce EDN data using this prompt (it will produce something that looks like the "grammar" displayed in the paste from above that GPT came up with, not Clojure data as instructed). I can get it to output EDN but I need to provide an example, but then the story in the example will tend to leak into the generated story. And it still has problems, missing keys for instance, or it doesn't used nested subnarratives, or just fails at outputting strict EDN, for instance forgetting or adding surnumerary parenthesis. Here's what the EDN structure I want to get might look like: https://pastebin.com/iTxtn8gk https://pastebin.com/iTxtn8gk And here's what kind of text can be generated from it: https://pastebin.com/qJPjmrTd https://pastebin.com/qJPjmrTd For now I haven't even used the parseable EDN programmatically. I just feed it back to GPT as a string (realistically, I'd need to use a vector database to store these narrative blocks). However GPT will slowly erode the structure with every round-trip.