Fantastic article; love the analogy comparing LLMs to compression algorithms. "In human students, rote memorization isnt an indicator of genuine learning, so ChatGPTs inability to produce exact quotes [...] is precisely what makes us think that it has learned something."