But models like ChatGPT show that language, when accessed at a massive scale, overcomes many of its limitations as a source of information. You and I will have to spend dozens of lifetimes reading 24/7 to see the number of words that GPT-3 considered during its training.