ChatGPT is extremely impressive, but one thing I noticed is that is can give the wrong answer with total confidence. Even if you call it out on a wrong answer, it can be like "You're right, I made a mistake", and then repeat the same wrong answer.