I heard a good podcast interview applying Frankfurt's notion of Bullshit to ChatGPT in a pretty illuminating way. Basically the problem is that it doesn't have an epistemology. It is not aiming at truth