The storm in a teacup about ChatGPT refusing to write a poem praising Trump is an example of why big tech companies like Google have been afraid to ship LLMs. The real nightmare scenario is a news story about ChatGPT/LaMDA writing a poem praising Hitler.