True that! The basic building blocks for ChatGPT have been around for a while. In particular, this is a generatively pre-trained transformer-based model and transformers and attention have been around since 2017. The original implementation due to