ChatGPT Is a Blurry JPEG of the Web The illusion of understanding is created by the lossy compression used by large-language models. To produce plausible answers, these models rephrase information from the web instead of quoting it word for word.