7 ms·
But it is specifically one of Claude's ticks
by jubilanti 5d ago
But it is specifically one of Claude's ticks
- moomin 5d agoIt is. And the reason for that is* surprising: the base knowledge corpus is clickbait internet articles. *not at all
- philipallstar 5d agoIt is more surprising than that: it's because the humans in the loop like it.
- twoodfin 5d agoThe LLMs are going to turn us into stochastic parrots.
- vkou 5d agoIf you're being given an A-B choice between cinnamon-flavored shit and lutfisk-flavored shit, you might convince the experimenter that cinnamon-flavored shit ranks highly in user preferences.
- lukeschlather 5d agoI would expect a preference for lutefisk flavored shit, the problem is then you then deduce from that that people prefer lutefisk flavor over cinnamon, rather than that you should stop feeding people shit (and also stop feeding them lutefisk.)
- twoodfin 5d agoI suspect it’s more like Claude etc. optimizing for a tone that gets the green checkmark from RLHF reviewers, probably over and over in many contexts where style is otherwise an incidental concern.