2 ChatGPT has a fine-tuning step. Let's look at how that likely works. The pretrained model is made to produce the output for each input. There will be a human responsible for labeling each output of the model in response to pre defined inputs, based on how accurate they are.