The "pretrained" part of the name refers to the fact that the model is first trained on a large corpus of text data, and then fine-tuned for specific tasks, such as answering questions or generating conversation.