Description of LLMs as lossy compression is not accurate. They model language, they do not record it, even in a lossy manner. When ChatGPT replies to a query, it is writing new text. A model of language is implicitly necessarily a model o