ChatGPT (and many others) use a 5 year old (2017) ReinforcementLearning from Human Feedback: once the AI model is pretrained, with Wikipedia, Reddit, and else, you let humans chat and rank the answers to fine-tune. /3