That is what Reinforcement Learning with Human Feedback (RLHF) does, as was used for ChatGPT. They've made a kind of classifier that estimates if other answers are closer the required helpfulness and correctness.