After launching GPT-3 they collected about 33000 prompts that users entered, and asked human labelers to provide example desired outputs. They first trained on this dataset to obtain ChatGPT version 0.1