Yes. But. Unless openAI open sources ChatGPT and its development procedures (including the online demo we so fondly use), we still dont know how much of it comes purely from pretraining, and how much is based on UI magic like add-on heur