A clear counter effect of Reinforcement Learning with Human Feedback (RLHF) applied to InstructGPT, i.e. instruction trained ChatGPT with the human in the loop (semi-supervised training). This is clearly not a result of a "deep hidden layer" guided intelligence.