RL from Human Feedback (RLHF) is the secret sauce behind chatGPT and Claude but human feedback is hard to scale. A neat alternative is to use another LLM for feedback. Feedback is easier than generation so it turns out RL from AI feedback can works well! Cool work by elicit!