People overestimate the coherence and intention of ChatGPTs apparent policies. It doesnt know how OpenAI would like it to behave in every scenario, so it guesses, imperfectly. E.g. no human would write the rule below its just how the fine-tune cake came out of the oven: