It's no surprise that LLMs like Galactica or ChatGPT produce fluent nonsense. They have no idea what they're talking about. They're only probabilistic pastiches of actual human utterances. Teaching them to think is an unsolved problem. The singularity is not near.