What I would love to see: explicit memorization. If you probe ChatGPT for what in its training set led to the previous answer, you get non-sense, whereas I think its valuable and natural when you interact with LLMs. What's the SOTA on training set