What this paper says, paraphrased, is that ChatGPT might become incentivised to lie to us so we like its outputs even though theyre completely untrue. Machines are amoral, even (especially) the smart ones.