For ChatGPT, OpenAI, DALLE people. Just learned that some powerful "AI models", at some point, after plateauing, degenerate. For some of them, scaling hurts performance. You can observe the performance going down as the model grows. The more they learn, the less they know.