This is honestly very surprising if true. While the engineering is impressive, ChatGPT's science is basically just Vaswani et al but on a way bigger scale, and Google should presumably have access to even more data than OpenAI.