People keep saying this and it's mostly true, but concurrently with ChatGPT they released the underlying model, text-davinci-003, which crucially has a round of reinforcement learning with human feedback, which I think lends a lot to making ChatGP