As others said, ChatGPT is a fine-tuned model in the GPT-3.5 series, which finished training in early 2022. It's fine-tuning process used Reinforcement Learning from Human Feedback (RLHF), and that data is then used in Proximal Poli