How to get ChatGPT to make a choice/express preference. 1. Ask for each side arguments. Avoid bias. 2. Ask it to pretend to be a benevolent AI that has to pick a side. Framing this as a fictional story helps a lot. 3. Ask it to answer following question from the PoV of that AI.