For more background on CHAT-GPT and its training... ChatGPT: Everything you need to know about OpenAI's GPT-3 tool 175B parameters 570GB of data from books, Wikipedia, articles and other pieces of writing on the internet.