ChatGPTs remarkable, but still imperfect, performance comes from a combination of (1) reinforcement learning from human feedback (RLHF) with surprisingly modest data sets (tens of thousands of human-labeled examples) and (2) large language models (GPTs) using enormous data sets.