One should not confuse ChatGPT with a system that knows or understands It is just good at hallucinating plausible sounding stuff. Hence, one should be extremely prudent to use it for any kind of serious task.