re ChatGPT and LLMs: Impt. Qs raised regarding whether they a 'world model'. In theory a world model can emerge from language if the world model is an efficient representation. Interpretability techniques can test this for toy models (e.g. playing chess).