OpenAI trained ChatGPT to be good at chatting by repeatedly holding conversations with it and then rewarding it for good responses and punishing it for bad onesa process called Reinforcement Learning from Human Feedback.