At times, what chatGPT is missing is in its depth of answers. It's scratching at the surface, but still not quite there. My view is that RLHF is incredible and necessary, but a noticeably blunt instrument at key points in a response.