Thought-provoking essay by Reinforcement Learning from Human Feedback (RLHF) is ChatGPT's response to overcome a weak feedback loop But it's hard to see information retrieval systems scaling without stronger, more embedded feedback loops.