7 ms·
The urge to put capitalized, repetitive, borderline abusive instructions should be studied. I haven't read many academic papers looking at the frustrations arou
by bertil 3mo ago
The urge to put capitalized, repetitive, borderline abusive instructions should be studied. I haven't read many academic papers looking at the frustrations around repetitive patterns.
- reactordev 3mo agoThere have been a few studies that have shown models produce worst responses when under duress from a frustrated user posting insults in all caps. https://arxiv.org/abs/2602.10144 https://arxiv.org/abs/2602.10144
- LordDragonfang 3mo agoIt's fundamentally because, despite (nearly) everyone's claims otherwise, the fact that we interact with them through language means we (our brains) model them as a sort of person. (Note that this fact is totally orthogonal as to whether it's actually sentient or not.) We then try and instruct them the same way we would a person totally subordinate to us. When a "person" that you don't view as a "real" person repeatedly does exactly what you just told it not to do (often amid false assurances it understands and will avoid doing so in the future), most people get angry. Compare it to how the kind of people who treat children like property treat their kids, or other examples of keeping people as property.
- lxgr 3mo agoIt should be relatively clear at this point that the model will in turn also model you as somebody that shows unrestrained anger with subordinates and adapt its responses accordingly. This might or might not be what you want.
- LordDragonfang 3mo agoGood addition. Fully agreed on that point, yes. (At the very least for larger models, if not also for smaller ones)
- notnaut 3mo agoIt reminds me of FIRMLY telling my cat to stop jumping up on the counter
- ur-whale 3mo ago> borderline abusive instructions who, or rather what, is being abused here exactly ?
- sirsinsalot 3mo agoI think intent, rather than target, is implied and important. You should see the abuse my motorbike gets. Poor thing.
- rimliu 3mo agoinanimate fucking object.
- saligne 3mo agoYeah says way more about the user than the model