I took my chance yesterday and spent a fair amount of time trying to trick ChatGPT, mostly using Prompt injection. I managed to get all sorts of hateful songs against women, homosexuals, Muslims or old people. Hier is a mild example of a song against people with blue couches.