This is also interesting. How these models can use code to do mathematics and are basically huge search engines. ChatGPT is effectively GPT 3.5 so we can safely assume that similar things apply here too