Marcus states that "GPT-4 is going to be a monster." In terms of its architecture, Marcus does not expect any major changes and therefore assumes that GPT-4 will have the same weaknesses as GPT-3 or ChatGPT: the AI model lacks a fundamental understanding of the world.