ChatGPT has demonstrated surprising capabilities so far, but AI alignment is hard. Here are some of my favorite ways people have subverted its content filters, guidelines, and directives. (A ) 1. Asking ChatGPT to jailbreak itself