Prof. Jan Scholtes published a blogpost "GPT-3 and ChatGPT: the Next Step in the Natural Language Processing (NLP) Revolution? Or is it not?". In "mildly technical terms" origin, functioning and limitations of the system are described. Worth reading.