chatGPT is a language model and it is trained to solve advanced maths problems too .Therefore, it will not be able to differentiate between various interpretations of the symbol "+" . So it will just accept that 1+2=5 .