I can confirm that ChatGPT makes shit up. I asked it to tell me about my Palestinian village, and it just made up this whole story that its in Iraq. I'm not an Iraq expert, but I couldn't find any such village there. If you google the term GPT used only Palestine comes up.