Language models like InstructGPT and ChatGPT utilize human feedback to improve text generation. The Stability-supported research organization CarperAI has released a new library for human feedback data collection!