I'm not sure why ChatGPT struggles with something so basic unless you apply the step-by-step trick but I am beginning to form the hypothesis that its basic relational etc reasoning seems to have been weakened by RLHF.