Correct me if wrong, but wasn't both InstructGPT and ChatGPT both RLHF-tuned? Perhaps the penalty for hallucinations wasn't strong enough? I wonder what the default temperature for `text-davinci-002-render` (ChatGPT model) is!