I'm talking about RLHF and the sort of fine tuning that causes entropy collapse. Like chatGPT. And yeah, simulations run by the base model could query the less creative and adaptive but robust and obedient Instruct model as an assistant.