I will call this the "Consistency Delusion". This is the nature of GPT models to try to maintain consistency even in the face of overwhelming evidence to the contrary. In this case, the model can recognize the right answer when the delusion is not in effect.