What's a reward model? 3/ A reward model is a system that is able to grade the output of its LLM or any model. In the case of ChatGPT, the reward model simulates human feedback. Its grade for output should reflect how a human would grade that output.