"ChatGPT sometimes writes plausible-sounding but incorrect (...) answers. Fixing this issue is challenging, as: (1) during RL training, theres currently no source of truth; (2) training the model to be more cautious cause