ChatGPT is an excellent demonstration of the alignment problem: OpenAI tried very hard to stop it from doing things like this, and yet it turns out that it is very, very hard to make an AI do what you want it to do, even if you put in a ton of precautions.