If you think of ChatGPT in terms of research, I agree. gpt3 has pretty much the same architecture as gpt2. However, it's the first LLM productized at scale, and this is very considerable! It's the combination of research and engineering that makes the difference!