7 ms·
Can you share any details or samples of the code/prompts especially with regards to "Gemini with structured JSON output" and "LLMs hallucinate quarters and M&A
by golden-face 1y ago
Can you share any details or samples of the code/prompts especially with regards to "Gemini with structured JSON output" and "LLMs hallucinate quarters and M&A tags. Solution: deterministic post-processing"?
I recently started using Gemini to perform perform classification tasks and I have been struggling with 2 things:
1) Documentation on the input/prompt schema when you want to require structured output
2) How to enforce outputs like "this key-value output must come from the supplied list of key-values"
It is really fascinating to work with this tool if only because it works well on 90% of tasks and then decides to go full stream of consciousness "hello good day, I know this is a horse race on TV but I cannot find the horse race in the list of car manufacturers you supplied" with a random schema for the output.