Likewise, in the case of citations, ChatGPT isnt overfitting to any specific citation; instead, its generalizing to a broader set of plausible authors, a collection of plausible titles and journals, and then some numbers in the right arrangement.