I do see all the amazing ChatGPT tweets, but nevertheless I cannot help to stay skeptical. See for instance this work I tweeted about recently: Transformer fail completely to learn some regular languages, including simple arithmetic equations!