ChatGPT and Anthropic are "taught" to be aligned using reinforcement learning. Is the resulting "filter" deep in the neural network, inherent to their being? Or a superficial layer filtering their true beliefs? I.e. they still think it, but don't say it out loud?