This data was then used to train another model - reward model that learns to replicate the human annotators. This new model will give feedback to the chat GPT models answers as a reward function to help it converge towards the best answer. (9/13)