An example: you use ChatGPT to autorespond to tweets. you don't want it to say nasty stuff, so you add a command to tell it to be positive. All goes fine until it misinterprets a tweet and tells someone mourning their child "Sounds great! Fantastic to hear."