GPT 3 (2020) took things to the next level by using the entire internet and tens of thousands of books for training, resulting in a model with 175 billion parameters. ChatGPT was also trained using a modified version of GPT 3 + human input in 2022.