ChatGPT struggles when answering trick questions. This is because, while It's a powerful language model, it is not yet AGI and does not possess the same mechanisms of reasoning that we take for granted. These mechanisms are actually learned from social context as we grow up.