The approach to train ChatGPT appears to be based on InstructGPT paper. They found hallucinations reduced by half in InstructGPT compared to ChatGPT. This improvement is perhaps due to human involvement in the first two steps - (1) writin