OpenAI put a truly remarkable amount of effort into making ChatGPT, a chatbot that would never say it loved racism. Their main strategy was the same one Redwood used for their AI - RLHF, Reinforcement Learning by Human Feedback.