2. Wrong Answers ChatGPT sometimes provides wrong answers very confidently. That is harmful because you cant tell when its wrong unless you already know the correct answer. If you don't know the answer it will fool you by lying with utter confidence.