Of course it's possible. ChatGPT uses a version of GPT3 finetuned using RLHF, where people rated model's responses, which then influences their probabilities. So if they were instructed to grade non-PC stuff poorly, model would l