When we see ChatGPT or other LLMs failing at sth, we often hear about the requirement of embodied experience. 100% agreement, however there is some minimal requirement for the computational capabilities that comes first. So let's look at the architecture of most current LLMs.