Those numbers may sound impressive, but theyre within range of 500B words that trained ChatGPT. Its successor, GPT-4, might be trained on tens of trillions of words. Rumors are GPT-4 will be able to generate a 60K word novel from single prompt