Ted Chiang suggests a metaphor for ChatGPT and other Large Language Models: you can think of them as a blurry JPG of the web. (Which is to say, a form of lossy compression.) A useful metaphor, and a good article.