I've never seen 'RLHF' used to describe what you're describing, which sounds like it involves supervised (non-RL) training on human demonstrations. Reasonable to guess ChatGPT used some of that, but 'RLHF' just uses human evaluations of model outp