It's actually learning (in part) from humans. "ChatGPT was optimized for dialogue by using Reinforcement Learning with Human Feedback (RLHF) a method that uses human demonstrations to guide the model toward desired behavior."