While fawning over ChatGPT remember: BERT, GPT-3 and Switch-C are step-changes in model size. They are based on "public" text and look for statistical patterns to predict word order, etc. This can produce vaguely accurate text