You can like/dislike chatgpt responses. This is used as a training signal to improve chatgpt. Now imagine there are a class of bad answers but which sound good to the average chatgpt user. Consider that users will like a bad response over no response...