RLHF was used by Instruct/ChatGPT to enable the models to better follow human instructions. It is also used by Sparrow to teach the LLM how to search the internet for evidence of factual claims. RLHF can be used to teach LLMs a variety of desired behaviors. [7/8]