7 ms·
Did people really struggle with getting JSON outputs from GPT4. You can literally do it zero shot by just saying match this typescript type. GPT3.5 would outpu
by bel423 3y ago
Did people really struggle with getting JSON outputs from GPT4. You can literally do it zero shot by just saying match this typescript type.
GPT3.5 would output perfect JSON with a single example.
I have no idea why people are talking about this like it’s a new development.
- brolumir 3y agoUnfortunately, in practice that works only most of the time. At least in our experience (and the article says something similar) sometimes ChatGPT would return something completely different when JSON-formatted response would be expected.
- tornato7 3y agoIn my experience if you set the temperature to zero it works 99.9% of the time, and then you can just add retry logic for the remaining 0.1%
- blamy 3y agoI've been using the same prompts for months and have never seen this happen on 3.5-turbo let alone 4. https://gist.github.com/BLamy/244eec016beb9ad8ed48cf61fd205428 https://gist.github.com/BLamy/244eec016beb9ad8ed48cf61fd2054...