To be clear, we don't know the exact policy/reward modeling used by ChatGPT, they haven't put out a paper yet, but have provided this: DeepMind's Sparrow 70B model can achieve very similar results with t