Nice paper (and thread) on the alignment problem from a deep learning perspective via It looks like ChatGPT knows facts about the models OpenAI tends to deploy, and sometimes uses those facts when responding to prompts.