Many phenomena including this may refer to inability of GPT-like models to keep up internal states analogous to working memory. Chain-of-thought prompting cues state on paper too. And hallucinations and errors chatGPT can sometimes correct when pointed at in its output.