Want to know more about Reinforcement Learning from Human Feedback (RLHF)? RLHF's used in chatgpt Check out this: They break it down into three steps: Pre train a LM, gathering data and training a reward model, and fine-tune the LM