This explanation of the technique ChatGPT uses during training leads to two conclusions: 1) The goal of ChatGPT is to give you an answer which makes you happy. Replying "I don't know" will not achieve that. Hallucinating wrong facts is more likely to please you