Do you know how ChatGPT was trained? ChatGPT is "simply" a fined-tuned GPT-3 model with a surprisingly small amount of data! It is first fine-tuned with supervised learning and then reinforcement learning. They hired 40 human labelers to generate the training data. Enjoy!