The real breakthrough of ChatGPT is solving the alignment problem: the alignment between the intention of the user and the action of the model. The rest of the components (GPT, PPO for reinforcement learning, dataset tagging, etc) have been there already.