Yes, I believe that both InstructGPT and ChatGPT (unclear if they are even different?) are trained using RLHF. My understanding is they use a binary label for "correct" or "incorrect", so "i don't know" isn't rewarded more than a hallucination