This is one of the most fascinating videos on YouTube. He builds a version of ChatGPT from scratch. You can see how it is essentially a prediction engine used to hash together data it's given. Read: It isn't making anything new.