This is why, I think, it feels like a weak objection to point out that ChatGPT confabulates a lot. Its a valid point! The model does make stuff up when it lacks real evidence. But this failure mode doesnt fit our expectations for computers thus doesnt feel insuperable.