ChatGPT builds a model in abstract space of language. Not just rules of grammar and definitions - but styles of writing, chatting, being funny, etc for all the stuff we do and have done with text. But it cant purposefully go beyond what is done with language as we do.