GPT-3 could always correct based on your feedback, since it's autoregressive. BUT, despite the fact that feedback is a very common part of the workflow with GPT-3, it wasn't actually optimized for that. Now, ChatGPT is! Here's how it was trained: