I think chatGPT fine tunes the autoregressive GPT3 using RLHF / Proximal Policy Optimization with instructions, which I think is a really significant additional training strategy. I believe that achieves meaning and under