Do you know how ChatGPT was trained? ChatGPT is "simply" a fined-tuned GPT-3 model with a surprisingly small amount of data! This process is fully described in here: The paper actually details a sibling model called InstructGPT.