Arguably, ChatGPT's own performance is itself an example of an emergent phenomenon: "more is different" when it comes to parameters and training exemplars. Nothing in the structure of the model directly implies the capacity to churn out novel perfectly grammatical sentences.