In January, OpenAI released a paper on InstructGPT, introducing Reinforcement Learning from Human Feedback (RLHF), which improved GPT-3 by getting humans to rate its responses. InstructGPT+more memory+more feedback=ChatGPT (in Dec). (2/10)