A useful test for chatbots is the 'Grandpa Test'. Feed it the lyrics of I'm My Own Grandpa ( - and ask it how many characters are in the song. For me ChatGPT first denies there are characters at all and when pressed just crashes.