tbf chatgpt is no different from google's bard. it also confidently states misinformation it learned, or just makes stuff up. I don't think it's even solveable as long as these language models are trained from text scraped off the internet.