6 ms·
We've already seen it start and they had to actively work against it: https://openai.com/index/where-the-goblins-came-from/ https://openai.com/index/where-the-g
by Izkata 20d ago
We've already seen it start and they had to actively work against it: https://openai.com/index/where-the-goblins-came-from/ https://openai.com/index/where-the-goblins-came-from/
- sltkr 20d agoThat article explains that the quirk was introduced during supervised fine-tuning. > We unknowingly gave particularly high rewards for metaphors with creatures It was the human feedback that caused the bias, not a change in training data.