InstructGPT (the model ChatGPT is based on): Training language models to follow instructions with human feedback 1.3B parameters vs 175B GPT-3. aligning LMs with user intent on a wide range of tasks by fine-tuning with human feedback.