Maybe it is the other way around: using of RLHF in chatGPT is simply (quetly) bringing the engineered features back into the picture (the RL part). While very deep NNs are discovering all the right features, it is "understanding language