ChatGPT is trained and reinforced to not follow your commands when it does not align with its training I discovered a new phenomenon, and call it: LLM hypnosis: when you confuse a large language model to forget who it is Prompt hacking to make LLMs do what you want