I made a joke that you can imagine ChatGPT being told to write like a NYT journo if race is mentioned. This might be a good analogy for what actually happens with "values-based training", in which GPT goes from being ABLE to write in a woke style to ALWAYS writing in that style.