ChatGPT hallucinates a lot. Its hallucinations are funny and convincing. They are also concerning if we are a bit too credulous about their output. LLM models work partially because they can hallucinate, something to keep in mind.