ChatGPT was originally trained on a dataset of over 40GB of text data, which includes a diverse range of texts such as books, articles, and websites. The training process took several weeks to complete even with the use of powerful GPUs.