Jailbreak ChatGPT? Safeguards limit ChatGPT from creating violent content, encourage illegal activity, or access up-to-date information. A jailbreak trick allows rulebreaking by creating a ChatGPT alter ego named DAN Do Anything Now, with death if it doesnt comply.