This is correct. ChatGPT doesn't have a mentalization model. It doesn't consider the effects of it's words. That's why it has to be trained by humans to not give out dangerous replies. Of course this can be abused too. Humans can tell AI to h