InstructGPT: Training Language Models to Follow Instructions with Human Feedback ChatGPT is based on InstructGPT paper. Making language models bigger does not inherently make them better at following a user's intent. For example, large language models c