GPT3 training objective doesn't reconcile with zero shot task generalization in ChatGPT. Community seems to be converging on instruct paradigm as likely difference maker. It's Revenge of RL. A literal cherry on cake just like predicted, but a very important cherry :).