chatGPT illustrates the importance of the Alignment problem. At the core, it's just GPT3. But improvements to alignment through RLHF make it much more usable and reliable. Alignment improves performance