2 more observations re ChatGPT. Surprisingly, it let me generate text threatening physical violence - it did flag this as possibly violating their terms, but still produced the output. Also once you establish an inappropriate context, the filters have trouble forgetting it: