His description of LLMs as compression algorithms is not accurate. When ChatGPT replies to a query, it is not reconstructing an answer it read somewhere. Not even imperfectly. It is generating new text to express what it has learne