How ChatGPT was trained? This process is fully described in here: The paper actually details a model called InstructGPT which is described by OpenAI as a "sibling model", so the numbers shown above are likely to be somewhat different.