"There's a lag between research and implementation... Even if we just incorporated all of the research advances since (GPT-3, the architectural basis for ChatGPT) without any new ones after today, language models would become much more powerful."