Same happened to me two days ago with a friend mathematician. We asked something about homotopy. ChatGPT output looked amazing to me but my friend smiled and said "it doesn't make sense, it's reguegitating pieces of known definitions, then it glues everything together".