Now, 2 1/2 years later, I would probably change a few things. ChatGPT LLMs are clearly producing meaningful text, even if often flawed. The big thing I missed was the sheer richness of emergent behaviour from LLMs - next-token prediction is a lot of what people do with words.