Especially if we want those standards to change, giving the politically-powerful special privileges to ignore the rules is bad! It makes reform less likely to occur, rather than more, and encourages other problems like regulatory capture and selective prosecution.
Shunned & shamed? Certainly.
Formal sanction is a form of govt award and needs to be used cautiously to avoid becoming an endorsement.