Perhaps there's something emergent here. If we "know" things and that's embedded in our language, and ChatGPT is trained on our language... is knowledge something that's simply encoded in stats? Maybe sequence prediction knowing something is a distinction without a difference.