The crux of ChatGPT is that an agent (LLM) is maximizing some reward which was learned via human feedback. In trad RL, the reward function is manually written. In RL with human feedback, the reward is learned by a parameterized NN. I will soon publish a literature review on it.