This process was pioneered by InstructGPT and extended by ChatGPT, a sister model. Both models are initialized via language model pre-training over a lot of unlabeled text (i.e., either from scratch or by using an existing pre-trained LLM like GPT-3). [2/10]