ChatGPT fails simple reasoning tasks. What is impressive is its ability to produce output that looks like it could be the right result, in spite of being demonstrably wrong. One of the most obvious tells that it lacks reasoning, is that it cannot reflect and correct itself.