ChatGPT is trained on 300 billion words, or 570 GB, of data. Which means large, uncurated datasets carved from the internet. While researchers use filters to prevent models from providing inappropriate information, these are not 100% accurate.