It's pretty interesting to see how ChatGPT fails despite all these safeguards - it is really one of the first true attempts to address the alignment problem in text transformers, and you can see they put in a lot of effort - the fact they f