He makes a reasoning error that LLMs are only creative if they produce output unseen in the input: information cannot be created, it can only come from somewhere else. ChatGPT has only seen texts, so indeed it cannot go outside that domain. 1