ChatGPT was buying data from lots of sources. Crawling it yourself from the web is not that trivial at scale. I mean sure, it's trivial to scrape a site. Adjust it to edge cases. Review the data. But try a billion sites.