According to ChatGPT, developers used text data of 570GB to train this languagemodel . It said that the training dataset was chosen to be diverse and representative of the different styles, topics, and registers of human conversation.