4) The remarkable thing is not that ChatGPT writes sentences that are false, it is that it writes sentences that are true. Of course, this is just a happy accident. LLMs have no idea whether a sentence they write is true or false. They have no judgement.