The breakthrough of ChatGPT by OpenAI highlights a fact that's overlooked by most AI researchers: Machine learning is about data first, model second. ChatGPT still using the same 4-year old architecture as original GPT. Dataset has been iterated expanded countless times.