My first experience with ChatGPT I asked it to construct a well-ordering of the real numbers and within 15 minutes it was claiming the Axiom of Choice is equivalent to its negation. It is frequently incorrect, but never lacks confidence.