GPT is literally trained to just reproduce texts as we would: its trained on basically all human writing, learns what is likely to come after a text string like this. ChatGPT is then trained by reinforcement to select