ChatGPT is really cool, and I think something that's not highlighted enough is how RL is (partially) used to train it. The blog post mentions it builds on the approach of instructgpt ( which is nice. Sad we don't get to know the amount of data gathered.