7 ms·
The searchable term is "Self-preference Bias" :) My first encounter with any kind of study was the G-Eval paper [1]. They study whether their LLM judge prefers
by abhgh 14d ago
The searchable term is "Self-preference Bias" :)
My first encounter with any kind of study was the G-Eval paper [1]. They study whether their LLM judge prefers human or LLM-generated summaries (answer: it's the latter).
[1] Section 4 in https://aclanthology.org/2023.emnlp-main.153/ https://aclanthology.org/2023.emnlp-main.153/