Apparently GPT-4 is going to have a language model 500x the size of GPT-3. I can't even imagine what this will be like given chatGPT is one of the most impressive technical feats I've seen in a long time.