I watched an interesting video that touched on this. The like/dislike response on chatgpt is used as a training signal, but this incentivises hallucination as a bad answer is nie likely to be liked than no answer at all.