The success of ChatGPT shows the power of Reinforcement Learning from Human Feedback. In this paradigm, models are aligned to values using a "reward model" trained on human preferences. I argue that it is imperative these reward models be open source: 1/