Whats driving the constant and accelerating AI innovation we are seeing almost weekly now, particularly in large language models (LLMs)? Or more simply, how on earth did openai create their new ChatGPT bot? The answer primarily is the innovation of transformers.