Thought I'd chime in here a bit from an understanding from what open ai has publicly shared so far - ChatGPT is trained with human feedback in the loop using an RL approach made popular in InstructGPT. This mainly improves memory and ability t