There have been a few studies that have shown models produce worst responses when under duress from a frustrated user posting insults in all caps.
replyIt reminds me of FIRMLY telling my cat to stop jumping up on the counter
replyIf my cat was an LLM, I'd use a different model. The current one is stuck in noisy useless arsehole mode.
replyare you asking it questions about security?
replydeleted
replyIt's fundamentally because, despite (nearly) everyone's claims otherwise, the fact that we interact with them through language means we (our brains) model them as a sort of person. (Note that this fact is totally orthogonal as to whether it's actually sentient or not.) We then try and instruct them the same way we would a person totally subordinate to us.
replyWhen a "person" that you don't view as a "real" person repeatedly does exactly what you just told it not to do (often amid false assurances it understands and will avoid doing so in the future), most people get angry.
Compare it to how the kind of people who treat children like property treat their kids, or other examples of keeping people as property.
It should be relatively clear at this point that the model will in turn also model you as somebody that shows unrestrained anger with subordinates and adapt its responses accordingly. This might or might not be what you want.
replyGood addition. Fully agreed on that point, yes. (At the very least for larger models, if not also for smaller ones)
reply> borderline abusive instructions
replywho, or rather what, is being abused here exactly ?
I think intent, rather than target, is implied and important.
replyYou should see the abuse my motorbike gets. Poor thing.
inanimate fucking object.
replyYeah says way more about the user than the model
reply