The recent surge in the legibility of LLM capabilities (exemplified in chatGPT) means the perceived rate of improvement is perhaps steeper than the reality, which is that most of these capabilities already existed in 2020 w/ GPT-3, w/ iterat