These two can be simultaneously true: 1) ChatGPT is, by far, the most impressive general-purpose chatbot we have ever seen. 2) There are still many exciting challenges in NLP that are not going to be solved by simply scaling up language models (even for dialogue systems!)