ChatGPT was trained using supervised fine-tuning. Human AI trainers provided responses for both the user and the AI assistant side and then ranked those responses. This labeled data was used to fine-tune GPT-3.5, the successor to GPT3.