ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers. Fixing this issue is challenging [because] during RL training, theres currently no source of truth, says the companys website.