2Transformer models (e.g. chatGPT) Transformers learn the meaning of words and the structure of language via contextual clues. One of the main advantages of such models is that they are self-supervised don't need explicit annotations in the training data.