I would say this actually is an artifact of mathematics being about semantic meaning, and not merely syntactic pattern matching. Not hard to have ChatGPT contradict itself and just spout out wrong answers that are syntactically vali