The "problem" with ChatGPT and similar systems is that they are *too* human in the way they "think". Most of our own thinking is really a sophisticated form of probabilistic pattern matching. The kind of *correct reasoning* that we would like to see is actually very machinelike.