Reading this paper, "Talking About Large Language Models", and it is an extremely well done high-level explanation of large language models (like what underlies ChatGPT) and how to conceptualize them / their limitations.