humans do this sort of thing too, the patterns are in the training data

I've seen many of the open weight models do this, or not, it's kind of random

A coworker commented that he thought they got dumber when they started simulating shame after getting something wrong