In recent years, the transformer architecture has made a revolution in NLP domain. It is based on attention models. BERT is based on the encoder part of the transformer. While GPT is the decoder component. ChatGPT is claimed to be based on GPT3 model.