As an example of the scale were talking about, the entirety of English Wikipedia, which comprises some 6 million articles, made up only 0.6% of the training data for GPT-3, of which ChatGPT is a variant. ~ Proton