It took us longer to go from the Mark I Perceptron to LSTMs (29 years) than from LSTMs to ChatGPT (27 years). It took us longer to go from Word2Vec to Transformers (4 years) than from Transformers to OpenAI's GPT3 (3 years). Exponential growth is wild.