ChatGPT is similar to InstructGPT with a few data collection differences (i.e., labelers use the LLM itself to help generate training examples for use during SFT). ChatGPT is also initialized using GPT-3.5 instead of GPT-3. Details on GPT-3.5: [7/10]