Transformers were introduced in 2017 by a team at Google Brain and are increasingly the model of choice for natural language processing problems replacing RNN models such as long short-term memory. ChatGPT is a model using transformers. This helps with AGI.