One of the reasons why ChatGPT performs better than GPT-3 is Reinforcement Learning with Human Feedback (RLHF). OpenAI hired large numbers of people to comment on the systems output, and label biased or offensive passages accordingly.