Want to know more about RLHF (which is behind chatgpt and other recent nlproc systems)? Check out this article: They break it down into 3 steps: 1. Pretraining a LM, 2. Gathering data and training a reward model 3. Fine-tuning the LM