It seems that what ChatGPT automates is the process of a person googling for an answer, not understanding any of it, and coming up with a misinterpretation that's taken as the truth. Given that millions of people do the same thing all the time, that's progress (in generating bs)