What is GPT ? GPT is trained using unsupervised learning, which means that it is not given explicit correct answers or labels for the data it is trained on. Instead, it learns to generate text by identifying patterns and structures in the data on its own.