Chalmers is going over the technical structure of LLMs, lumping together BERT, GPT, PaLM, and ChatGPT. This is a problem because something like BERT has a different technical structure than GPT and, if were thinking about these as mind, would have to think differently.