If ChatGPT still uses byte pair encodings then it will always be bad at math, since it can't see digits, only chunked tokens. Imagine if you had to special case memorize 10+21=31, 10+22=32 all totally separately!