I believe that InstructGPT was the lynchpin that led to a stepwise improvement in several tasks (e.g, rhyming). This is oversimplified, but I see ChatGPT as InstructGPT 0.2 + UX. Anecdotally, I noticed that rhyming got b