Feedback is good, though unlike their contractor feedback which entailed a lot of detailed guidance. I spoke at some length with OpenAI cofounder John Schulman about how they did InstructGPT ("sibling model to ChatGPT"), learning from human feedba