where systems like ChatGPT get weird is that theyre able to provide detailed explanations backing up incorrect claims. It is easier to produce than refute bullshit, and ChatGPT can produce and defend bullshit to an impressive degree.