A hypothetical AGI version of ChatGPT would be just as incentivized to get humans to believe incorrect things if doing so would result in a higher (predicted) reward. Why would it be otherwise incentivized?