A notable example of those LMs is ChatGPT. ChatGPT was trained using Reinforcement Learning from Human Feedback (RLHF). RLHF is basically using RL to train a language model from human feedback. HuggingFace wrote a whole article on RLHF recently.