ChatGPT's guardrails make sense given that OpenAI thinks AI will get WAY more capable than humans. Their real worry isn't ChatGPT/ GPT3 telling you a violent story, it's GPT10 telling you how to make a bioweapon. Better to solve AI alignment now while the stakes are lower