This is because ChatGPT is trained on huge amount of text from the internet and then fine tuned on examples of human dialogue. This dialogue format makes it possible for ChatGPT to answer follow up questions and admit its mistakes.