InstructGPT is One of the Models Behind the Magic of ChatGPT "OpenAI used a technique known as reinforcement learning from human feedback to fine-tune GPT-3 to understand written instructions better."