LLMs like GPT3 and ChatGPT generate one token at a time. No one serious is claiming they do more than that - What is very curious is that thought-like language gets generated. It raises interesting questions about cognition, intelligence and language.