It has datasets, so it was given extracts from various places. Books, news pages, instruction manuals, I'm not sure if they included images and audio. But wouldn't surprise me, chatgpt is smart, they must have had lots of d