There is another source of learning in ChatGPT that might be relevant: a team of human labelers were hired to rank the quality of the model outputs in conversations, and the model was fine-tuned to improve that metric of quality. Human biases