imo not enough ppl are talking about the reward model in RLHF. the reward model is basically a network that encodes 'human values'. obtaining a dramatically better, more robust reward model seems like a core alignment concern, especially w the ChatGPT buzz vindicating RLHF