With this new dataset, they are able to train a different model called the reward model. This model takes in a prompt and a ChatGPT response, and outputs a score, representing how good the response is according to human.