I tried ChatGPT, it does not know about Chinchilla and other recent models, looks like the data it was trained on are a bit "historic". Which reinforces my belief that continual learning of LLMs and other models (Gato etc) is important to