There may be something specific to the multi-turn dialogue nature of ChatGPT. And also human preference tuning - instead of giving (prompt, output) pairs, a company might provide (prompt, output variations, human ranking). Im not sure, but