As you fawn over ChatGPT: BERT, GPT-3 and Switch-C are step-change in model size. The models are still based on "public" text and look for statistical patterns to predict word order, etc. This can produce "50-50" text - looks good at 50 ya