7/ Lastly, RLHF: Reinforcement Learning from Human Feedback This allows LLMs to adapt to human feedback without re-training from scratch, which is expensive and slow. I assume that the thumbs up down UX in ChatGPT collects this data for