5 ms·
Looks great! How does the system detect hallucinations?
by jdbtech 1y ago
Looks great! How does the system detect hallucinations?
- iabouhashish 1y ago[dead]
- fryz 1y agoYeah great question We based our hallucination detection on "groundedness" on a claim-by-claim basis, which evaluates whether the LLM response can be cited in provided context (eg: message history, tool calls, retrieved context from a vector DB, etc.) We split the response into multiple claims, determine if a claim needs to be evaluated (eg: and isn't just some boilerplate) and then check to see if the claim is referenced in the context.