But if you want to bias a language model in terms of its "beliefs", you don't even need to go as hard as manual intervention like the ChatGPT interface. Simply curate its dataset of "conversational" sample data. The conversations in its dataset are all it knows about conversation