ChatGPT is resumed from a "GPT3.5" checkpoint, which is probably, like GPT3, trained *mostly* on text derived from Common Crawl. I believe OpenAI also adds some extra data they don't disclose the source of, but you should assume any text reachab