GPT2 was trained on 1.5 billion parameters, GPT3 has 175 billion, and GPT4 is expected to have 100 trillion. If you think ChatGpt is mad, just wait and see what it's going to do with the fourth generation of GPT.