I've been getting a lot of emails from faculty, and seeing tweets, where we ask a classic question and look at the chatGPT answer, and sometimes it appears to give a reasonable answer until you think deeply and realize it is total rubbish.